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CHAPTER  I 


INTRODUCTION 
Development  of  the  Problem 

The  impetus  for  the  study  of  the  ambulatory  care  Quality  Assurance  Program 
at  the  US  Army  Medical  Department  Activity,  Fort  Belvoir,  Virginia,  has  been  the 
coliective  lack  of  useable  information  by  which  the  hospital  staff  can  make 
intelligent  decisioris  regarding  the  quality  of  care  given  by  the  hospital  staff  in 
ambulatory  care.  Repeatedly,  the  outcome  of  quality  assurance  (QA)  related 
committee  meetings,  i.e.,  the  Medical  Care  Evaluation  Committee,  Ambulatory 
Care  Committee,  and  other  quality  assurance  functions,  was  not  useful  because  the 
committee  was  unable  to  identify  problems.  This  inability  to  identify  problems  is 
related  to  lack  of  information  which  the  committees  have  available  to  them. 
Although  data  is  present  it  is  either  not  properly  summarized,  incomplete,  or  not 
communicated  in  a  useful  manner.  Data  by  definition  is  not  information  due  to  the 
fact  that  it  does  not  convey  a  complete  picture. 

The  Chief,  Professional  Services  has  repeatedly  expressed  his  frustration  at 
the  lack  of  production  of  useful  quality  assurance  results  by  the  committees, 
departments,  and  activities  of  the  institution.  In  addition,  the  shortcomings  of  the 
hospital  Quality  Assurance  Program  have  been  noted  by  the  Joint  Commission  on 
Accreditation  o  Hospitals  OCAH)  on  their  most  recent  accreditation  visit  (June, 
1981).  Also,  the  General  Accounting  Office  conducted  a  five  week  survey  of 
hospital  quality  assurance  programs  and  noted  shortcomings  highlighting  the  need 


for  more  information. 


The  increasing  importance  of  quality  assurance  as  evidenced  by  the  heightened 
interest  by  regulatory  agencies,  both  private  and  governmental,  and  the  rising 
expectations  of  consumers  mandates  that  the  administration  of  hospitals  institute 
effective  and  efficient  quality  assurance  programs.  Major  General  Raymond 
Bishop,  Commanding  General,  United  States  Army  Health  Services  Command, 
specifically  addressed  the  issue  of  quality  assurance  in  troop  medical  clinics  and 
health  clinics  within  the  command  as  being  of  primary  interest.  ^  General  Bishop 
expressed  grave  concern  over  the  quality  of  care  provided  in  the  outpatient  setting. 
In  order  to  assure  that  the  care  provided  in  those  settings  is  optimal  he  stressed 
quality  assurance  programs  to  measure  the  efficacy  of  health  care.  To  validate  his 
interest  General  Bishop  has  instructed  the  Inspector  General  of  Health  Services 
Command  to  evaluate  the  quality  of  health  care  being  provided  in  the  ambulatory 
care  settings  throughout  the  command. 

Statement  of  the  Problem 

To  determine  the  best  system  for  ambulatory  care  activities  to  gather 
information  to  evaluate  the  quality  of  outpatient  care  provided  at  the  US  Army 
Medical  Department  Activity,  Fort  Belvoir,  Virginia. 

Objectives 

The  objectives  of  this  study  are  threefold: 

1.  To  determine  the  type  of  information  which  is  needed  by  outpatient 
organizations  to  evaluate  the  quality  of  care  provided  by  that  clinic.  Concurrent 
with  that  initiative  is  the  determination  of  the  proper  source  of  the  needed 
information. 
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2.  To  develop  a  methodology  for  extracting  the  needed  data  and  converting 
it  to  useful  information. 

3.  To  create  a  vehicle  for  displaying  the  information. 

Criteria 

The  criteria  by  which  the  results  will  be  evaluated  against  will  include; 

1.  The  methodology  for  extracting  data  must  be  performed  by  clerical  or 
paraprofessional  personnel. 

2.  The  source  of  the  data  must  be  readily  available. 

3.  The  methodology  for  converting  data  to  information  must  be  performed 
by  clerical  or  paraprofessional  personnel. 

U.  The  vehicle  to  display  the  information  must  be  standardized  so  that 
clerical  and  paraprofessional  personnel  can  display  the  information. 

5.  The  information  must  be  acceptable  to  the  clinic/activity/department 
chief  conducting  the  quality  assurance  program. 

Assumptions 

The  course  of  this  study  will  be  guided  by  several  factors  which  are  assumed 
by  the  author  to  be  true  and  will  determine  whether  the  study  will  be  viable  in  the 
future.  Those  assumptions  are; 

1.  The  need  for  quality  assurance  activities  will  not  diminish. 

2.  Clerical  and  paraprofessional  personnel  will  be  responsible  for  gathering 
the  data,  converting  the  data  to  information,  and  displaying  the  information. 

3.  The  recommended  method  for  gathering  information  will  be  applicable  to 
all  outpatient  clinics. 
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Limitations 


The  following  limitations  will  be  utilized  in  evaluating  this  program: 

1.  High  volume  clinics  will  be  used  as  models  to  analyze  and  develop  the 
quality  assurance  activities  of  ambulatory  care  activities  due  to  the  large  number 
of  separate  clinics  in  the  hospital. 

2.  The  individuals  who  will  perform  the  data  gathering  and  other  tasks 
involved  in  the  system  will  be  from  existing  resources. 

3.  Additional  resources  will  not  be  available  to  the  hospital  to  gather  the 
information  needed  to  assess. 

Research  Methodology 

In  order  to  fulfill  the  objectives  of  the  study  the  following  research  techniques 
will  be  utilized. 

1.  Identification  of  needed  information. 

a.  Consult  appropriate  literature. 

b.  Interview  the  professional  staff  of  the  outpatient  facility. 

2.  Identification  of  data  sources. 

a.  Consult  with  the  US  Army  Biostatistical  Agency. 

b.  Investigate  the  Information  locally  available. 

(1)  The  patient  health  record. 

(2)  Laboratory,  radiology,  and  pharmacy  data. 

(3)  Patient  representative  data. 

(4)  Patient  Administration  Division  maintained  data. 

(5)  Uniformed  Chart  of  Accounts  data  maintained  by  the  hospital 
comptroller. 
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3.  Method  for  extracting  data. 

a.  Automated  systems  available  by  the  BioStat  Agency. 

b.  Locally  maintained  statistics,  i.e.,  laboratory,  radiology,  and  pharmacy 
data. 

c.  Application  of  statistical  techniques  such  as  sampling. 

d.  Need  for  concurrent  versus  retrospective  data  collection. 

e.  Assessing  the  need  for  criteria  in  order  for  clerical  personnel  to  be  able  to 
extract  data. 

4.  Display  of  data. 

a.  Analyze  the  nature  of  the  data  collected  and  determine  the  most 
appropriate  type  of  display.  Possible  alternatives  would  includes 

(1)  Descriptive  statistics  (mean,  standard  deviation,  mode,  etc.). 

(2)  Trending  as  a  method  to  determine  abnormalities. 

(3)  Tests  of  statistical  significance,  i.e.,  Chi-squared,  T-Test, 
correlation. 

b.  Develop  a  worksheet  by  which  the  data  could  be  consolidated. 

c.  Utilize  currently  available  statistical  packages  on  the  hospital  Hewlett- 
Packard  minicomputer  design  mechanism  for  inputing  the  data  and 
producing  usable  information  for  the  clinic  chief. 
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Footnote 


i Major  General  Raymond  Bishop,  "Keynote  Address,"  presented  at  the  US 
Army  Health  Services  Command,  Ambulatory  Care  Conference,  Fort  Sam  Houston, 
Texas,  29  March  1982. 
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CHAPTER  II 


LITERATURE  REVIEW 
Introduction 

Quality  assurance  is  not  a  subject  for  debate,  its  time  has  arrived.^ 
Verification  of  the  mandate  for  quality  assurance  is  widely  published  in  federal 
law,  national  hospital  accreditation  standards,  and  Department  of  the  Army 
regulations. 2>  3,  4,  5  The  impetus  for  quality  assurance  activities  has  been  two¬ 
pronged.  The  critical  issue  in  assuring  the  quality  of  care  provided  is  improvement 
of  health  status  of  the  patient. ^  Concurrent  with  the  need  for  quality  health  care 
is  the  need  to  control  the  rising  cost  of  providing  health  care. 7  Although  the  thrust 
of  quality  assurance  activities  has  been  centered  in  the  inpatient  setting  there  is  an 
overwhelming  need  to  carry  the  quality  assurance  banner  to  the  ambulatory 
setting.  The  volume  of  patients  seen  in  the  outpatient  setting  is  tremendous, 
approximately  89%  of  illnesses  are  treated  in  the  ambulatory  mode.^  Even  though 
the  per  patient  expense  of  outpatient  care  is  obviously  much  lower  than  an 
inpatient  visit  the  magnitude  of  volume  of  outpatient  visits  necessitates  an 
evaluation  of  the  care  provided.  For  every  person  admitted  to  DeWitt  Army 
Community  Hospital  57  patients  are  seen  on  an  outpatient  basis.^ 

Structure,  Process  or  Outcome 

With  the  tremendous  number  of  outpatients  being  seen  in  an  ambulatory  mode 
the  target  of  quality  assurance  programs  heretofore  has  relied  heavily  on  the 
structure  of  the  system.  Structure  refers  to  innate  characteristics  of  the  providers 
(physicians,  dentists,  nurses,  etc.),  such  as  age,  type  of  medical  training  and 
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degree,  and  practice  of  the  physician.  jhe  "structural"  approach  assumes  that 
given  the  proper  mix  of  training,  age,  and  experience  a  provider  would  fulfill  the 
needs  of  the  patients.  The  guardians  of  the  "structural"  system  of  assuring  care 
were  the  members  of  the  medical  professions  via  state  boards  of  licensure,  medical 
societies  at  the  county,  state,  and  national  level,  and  faculties  of  medical  schools. 
The  effectiveness  of  the  structural  method  is  questionable.  The  increase  in 
malpractice  lawsuits,  the  maldistribution  of  medical  practitioners,  and  the  claims 
of  unnecessary  surgery  indicate  that  the  effectiveness  of  the  structural  method  is 
suspect.^  U  12,  13 

The  "process"  method  of  quality  assurance  activities  is  centered  on  the  events 
which  occur  during  a  patient  encounter.  The  "process"  includes  the  patient's 
history,  physical  findings,  laboratory  studies,  radiographic  tests,  drugs  prescribed, 
patient  instructions,  and/or  any  other  intervention  which  might  be  considered 
necessary  in  treating  a  particular  patient.  1^  The  process  has  significant 
advantages  over  the  structual  method  in  that  attention  is  focused  on  what  occurred 
during  the  encounter,  not  merely  how  prepared  the  provider  was  for  treating  the 
patient.  The  effectiveness  of  the  process  review  has  been  demonstrated  in  several 
studies.  In  New  Mexico  a  process  review  was  used  to  count  the  inappropriate  use 
of  antibiotics.  The  process  review  was  successful  in  reducing  the  frequency  of 
inappropriate  use  of  expensive  antibiotics.  1 5 

The  last  method  of  reviewing  the  quality  of  care  is  the  outcome  method.  The 
"outcome"  method  is  concerned  with  the  net  result  whether  it  be  cure,  control  of 
disease,  or  symptomatic  improvement.  The  ultimate  quest  of  quality  assurance  is 
to  improve  the  health  status  of  the  patient.  The  outcome  method  focuses  on  just 
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that,  the  health  status  of  the  patient.  The  structural  method  only  certifies  the 
initial  competence  of  the  provider  and  the  process  method  only  assesses  the 
fulfillment  of  measurable  inprocess  milestones.  Neither  of  these  methods  assesses 
the  quality  of  the  end  product,  the  patient.  The  logical  question  then  is  why  not 
use  "outcome"  as  the  sole  measurement  of  quality?  The  answer  in  part  is  that  the 
great  majority  of  conditions: 

-  are  self -limiting, 

-  are  intimately  involved  with  personal  life  style, 

-  are  chronic  conditions  where  a  good  outcome  is  often  temporary  arrest  of 
the  natural  cause  or  restoration  of  some  function,  but  is  in  either  case  dependent 
on  nursing  and  social  support  rather  than  medical  care, 

-  are  conditions  for  which  modern  remedies  are  only  partially  effective, 

-  require  short-term  counseling  or  reassurance,  often  effectively  practical  but 
generally  unrecorded,  and 

-  are  uncomplicated,  acute  infections  for  which  antibiotics  are  readily 
prescribed. 

In  addition,  anywhere  from  25  to  70  percent  of  patients  coming  for  care  are 
actually  well  or  "worried  well". 

The  net  result  of  the  three  methods  of  assuring  quality  is  individually 
ineffective  in  improving  the  quality  of  care.  There  is  a  place  for  each  of  the 
methods  in  the  overall  quality  assurance  program.  The  structure  of  the  health  care 
system  is  well  defined  by  the  operating  programs  of  hospitals.  T.  Include: 

-  a  credentialing  process, 

-  a  training  program,  and 

-  an  equipment  and  facilities  upgrade  program. 
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The  process  method  is  the  foundation  for  the  appraisal  of  the  compliance  of 
the  professional  with  established  patient  care  criteria.  The  existence  of 
imperfections  in  the  process  method  should  be  recognized  by  the  professional  body. 
Criticism  of  the  process  method  is  well  documented  in  the  literature  and  is  well 
founded. 20,  21  jp  light  of  the  shortcomings  in  the  process  review 
methodology,  its  ability  to  demonstrate  behaviors  is  critical  in  order  to  fulfill  the 
tenets  of  the  accreditation  standards  espoused  by  the  Joint  Commission  on 
Accreditation  of  Hospitals. 

The  outcome  quality  of  care  assessment  method  is  the  optimal  method  but  is 
the  most  difficult  to  define.  The  health  status  of  an  individual  includes  more  than 
a  simple  physical  assessment  of  an  individual  body.  The  World  Health  Organization 
includes  in  its  definition  of  health  status  the  "complete  being"  that  encompasses 
the  emotional  and  social  as  well  as  the  physical  aspect  of  the  being.22  The 
wholistic  movement  has  brought  the  "total  man/woman"  issue  to  the  forefront  and 
as  yet  this  issue  is  not  resolved. 23  in  order  to  avoid  the  pitfall  of  attempting  to 
define  "improved  health  status"  the  basis  of  an  ambulatory  care  quality  assurance 
program  would  be  wise  to  recognize  the  outcome  aspect,  and  focus  its  efforts  on 
the  more  tangible  aspects  of  a  process  orientated  methodology. 

Implicit/Eyplicit  Judgement 

The  process  system  can  be  based  on  a  combination  of  implicit/explicit 
judgement  and  concurrent/retrospective  data  collection.  The  difference  between 
explicit  and  implicit  judgement  is  the  pre-establishment  of  criteria.  The  implicit 
judgement  is  based  solely  on  personal  experience  and  training  of  the  individual 
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reviewer.  The  reviewer  would  audit  a  medical  record  and  determine  whether  the 
proper  medical  steps  in  diagnosis  and  treatment  were  taken  based  on  his/her 
opinion  of  what  constitutes  quality  care.2^  This  method  of  assessing  care  is 
extremely  flexible  but  requires  a  high  degree  of  knowledge  on  the  part  of  the 
reviewer  and  the  results  are  unreliable.25 

The  explicit  review  relieves  the  reviewer  of  the  judgmental  situations  which 
are  incorporated  in  the  implicit  system.  The  explicit  review  is  based  on  a  set  of 
standards  which  are  established  by  a  group  of  providers  before  the  review  and  are 
reduced  to  writing.  This  system  increases  the  reliability  of  the  review  and  allows 
paraprofessional  and  clerical  personnel  to  perform  the  review. 

A  study  conducted  by  Johns  Hopkins  physicians  of  296  patients  at  Baltimore 
City  Hospital  used  both  the  implicit  and  explicit  methods  for  assessing  the  quality 
of  care  provided. 27  The  diagnosis  for  these  patients  was  either  hypertension, 
urinary  tract  infection,  or  gastric/duademal  ulcer. 

The  296  records  were  reviewed  using  implicit  judgement  of  the  process  and  the 
result  was  that  23  percent  of  the  charts  were  acceptable.  The  same  charts  were 
then  reviewed  against  explicit  criteria,  and  the  result  was  1  percent  of  the  records 
met  the  acceptability  standards.  This  study  points  up  the  wide  variation  which  can 
exist  between  implicit  and  explicit  judgement  in  reviewing  medical  processes.  This 
variation  coupled  with  the  problems  of  unreliability  and  expense  associated  with 
implicit  judgement  indicates  that  explicit  judgement  is  the  method  of  choice. 

Prospective,  Retrospective,  and  Concurrent  Assessment 
The  quality  assurance  standard  of  the  Joint  Commission  on  Accreditation  of 
Hospitals  states  that  "once  an  actual  or  suspected  problem  is  identified,  it  may  be 
assessed  prospectively,  concurrently,  or  retrospectively. 28  in  the  ambulatory 
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setting  the  collection  of  data  needed  to  conduct  reviews  or  audits  of  patients 
encountered  is  not  systematic  and  centralized  as  is  the  case  in  inpatient  care.  This 
lack  of  a  systematic  data  collection  effort  severly  limits  the  ability  to 
retrospectively  analyze  care.  With  over  1  billion  outpatient  visits  occuring 
annually  in  the  United  States  the  system  for  centrally  collecting  data  is  not 

imminent. 29 

The  prevelance  of  quality  assurance  studies  documented  in  the  literature 
reflect  computer  assisted  data  collection  techniques.30>  31,  32  fhe  billing  function 
in  private  practice  has  provided  a  natural  index  for  identifying  patient  diagnosis 
and  treatment  data.  In  those  practices  which  have  automated  billing,  the 
practitioners  have  capitalized  on  the  captured  data  to  identify  patients  with  a 
specific  diagnosis  or  who  have  undergone  an  identifiable  treatment.  The  Harvard 
Community  Health  Plan  has  used  a  computer  stored  ambulatory  record  (COSTAR) 
system  to  record  patient  data.  This  system  significantly  improves  the  efficiency  of 
the  plan's  quality  assurance  efforts. 33  The  Army  Medical  Department  is  currently 
testing  the  COSTAR  system  at  Fort  Ord,  California. 3^  The  results  of  the  test  are 
not  completed  and  possible  proliferation  of  the  COSTAR  system  through  the 
military  hospital  system  is  uncertain. 

Without  the  aid  of  computerized  systems  for  records  retrieval  the 
retrospective  audit  technique  is  not  a  viable  method  for  conducting  quality 
assurance  studies.  The  concurrent  audit  procedure,  which  is  based  on  the  premise 
that  the  chart  is  reviewed  shortly  following  the  patient  encounter,  is  a  plausible 
alternative  to  retrospective  review.  The  term  shortly  is  used  to  describe  the  time 
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lapse  between  encounter  and  review  because  the  actual  time  can  vary  from 
minutes  to  days.  Concurrent  review  has  been  used  to  alleviate  the  personnel  cost 
associated  with  records  retrieval  and  to  cut  the  time  to  complete  a  study. jhe 
effectiveness  of  concurrent  review  is  not  oniy  in  the  retrieval  of  records  but  also  in 
corrective  patient  intervention. 

The  Automated  Military  Outpatient  System  has  been  used  for  over  five  years 
in  Army  hospitals  to  treat  large  numbers  of  outpatients  by  utilizing 
paraprofesslonal  personnei  to  treat  minor  illnesses.  Incorporated  in  that  program  is 
a  mandatory  concurrent  review  mechanism. 36  This  review  not  only  enables  the 
reviewer  to  detect  general  trends  in  the  quality  of  care  provided,  but  additional 
specific  shortcomings  in  the  treatment  of  a  patient  can  be  rectified  by  recalling 
the  patient  to  the  clinic.  The  recall  of  patients  is  not  practical  in  a  retrospective 
review  since  a  lengthy  time  lapse  between  the  time  of  treatment  and  the  time  of 
review  has  occurred.  Additionally,  inappropriate  actions  by  staff  members  can  be 
quickly  stopped.  The  advantages  of  ease  of  record  retrieval,  recall  of  patients,  and 
prompt  correction  of  staff  deficiencies  denote  the  concurrent  review  techniques  as 
superior  to  retrospective  reviews  in  the  outpatient  setting. 

In  addition  to  the  retrospective  and  concurrent  assessment  techniques,  the 
JCAH  refers  to  prospective  assessments.  The  prospective  aspects  of  quality 
assurance  deals  with  both  the  structure  of  patient  encounter  and  pre-establishment 
of  valid  assessment  criteria.  The  structural  system  has  been  discussed  previously 
as  well  as  development  of  explicit  criteria.  These  two  factors  are  important  in  a 
quality  assurance  program  but  without  the  concurrent  or  retrospective  review  the 


13 


effectiveness  of  the  prospective  aspects  of  the  progam  cannot  be  validated.  The 
prospective  methodology  cannot  stand  alone;  it  must  be  incorporated  into  the 
concurrent  or  retrospective  analysis. 

Conclusion 

The  need  for  quality  assurance  programs  is  not  going  to  vanish.  The  thrust  of 
outpatient  quality  assurance  should  be  on  the  process  of  the  patient  encounter. 
While  recognizing  the  importance  of  the  structure  and  outcome  portions  of  the 
ambulatory  care  system,  the  practitioners  should  insure  that  the  "process"  which 
they  can  directly  affect  is  optimal.  The  evaluation  of  the  care  provided  must  be 
based  on  clinicaliy  valid  criteria.  Implicit  criteria  requires  an  extremely 
competent  reviewer  and  the  reliability  of  the  assessment  process  is  questionable. 
Explicit  criteria  enables  a  lesser  trained  individual  to  perform  audits  and  achieve 
superior  assessment  results. 

In  the  outpatient  setting  the  Inability  to  efficiently  and  quickly  retrieve 
patient  charts  mandates  the  use  of  concurrent  audit  techniques.  The  ability  to 
promptly  intervene  in  a  treatment  is  a  significant  positive  side  effect  of  the 
concurrent  audit. 

In  summary,  the  outpatient  quality  assurance  program  needs  to  focus  on  the 
process  of  the  patient  encounter,  using  explicit  criteria  on  a  concurrent  basis.  This 
triad  of  principles  is  not  applicable  in  all  situations  but  any  individual  conducting  a 
study  would  be  wise  to  consider  their  application. 
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CHAPTER  in 

THE  PRESENT  AMBULATORY  CARE  QUALITY  ASSURANCE  PROGRAM 
General  Description  of  Outpatient  Services  at  DeWitt  Army  Community  Hospital 

DeWltt  Army  Community  Hospital  is  located  on  Fort  belvoir,  Virginia  in  a 
geographical  region  which  encompasses  Virginia,  West  Virginia,  and  a  portion  of  the 
Washington)  D.C.  metropoiitian  area.  It  is  a  120  bed  hospital  which  provides 
primary  care  to  a  population  of  approximately  S5,000  beneficiaries.  The  hospital 
services  include;  family  practice,  general  surgery,  obstetrics  and  gynocology, 
orthopedics,  neurology,  outpatient  psychiatry  and  social  work,  pediatrics, 
dermatology,  physical  therapy,  ophthalmology  and  optometry,  internal  medicine, 
and  emergency  medicine.  The  hospital  has  one  residency  program  in  family 
practice  with  eighteen  residents  participating.  The  average  patient  census  is  97 
patients  per  day  and  an  average  of  three  births  occur  daily.  There  are  currently  82 
physicians  assigned  to  the  institution. 

The  hospital  operates  37  separate  clinics  which  together  treated  437,826 
patients  in  fiscal  year  1981.^  These  clinics  vary  greatly  in  location,  size,  and  type 
of  patients  seen.  The  Adolescent  Clinic  cared  for  1,303  teenagers  in  fiscal  year 
1981  and  the  Family  Practice  Clinic  cared  for  over  46,000  patients  in  the  same 
time  period.  In  addition  to  the  wide  variation  in  number  of  patients  seen,  the 
clinics  also  vary  greatly  in  location.  Many  of  the  clinics  are  based  in  the  confines 
of  the  main  hospital,  but  some  clinics,  such  as  Fort  A.P.  Hill  Health  Clinic,  45 
miles  south  of  Fort  Belvoir,  are  located  off  the  installation.  It  is  therefore 
difficult  to  identify  a  typical  clinic. 
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The  responsibility  for  the  operation  of  the  clinics  within  the  hospital  is  divided 
(see  Figure  1).  The  Department  of  Medicine  is  responsibie  for  those  clinics  which 
are  subordinate  to  the  department  such  as;  pediatrics,  neurology,  dermatology, 
internal  medicine,  and  cardiology.  The  Chief  of  Surgery  is  responsible  for  typical 
surgical  specialities;  general  surgery,  obstetrics  and  gynecology,  orthopedics, 
ophthalmology  and  optometry,  podiatry,  and  urology.  The  Department  of  Family 
Practice  has  been  given  the  responsibility  for  not  only  the  family  practice  clinic, 
but  also  the  emergency  room,  physical  examination  clinic,  and  the  troop  health 
clinics.  The  troop  health  clinics  are  included  under  the  Chief  of  Family  Practice 
because  the  physicians  operating  these  clinics  are  family  practitioners. 
Additionally,  tiie  Chief  of  Family  Practice  is  responsible  for  the  off  post  health 
clinics.  To  accommodate  this  increased  responsibility,  the  Chief  of  Family 
Practice  has  the  collateral  duty  of  Director  of  Primary  Care  and  Community 
Medicine. 

Outside  of  the  three  major  departments  there  are  still  outpatient  clinics  which 
operate  under  a  variety  of  names.  The  Occupational  Health  Clinic  is  supervised  by 
an  autonomous  occupational  health  physician.  The  Chief  of  the  Community  Mental 
Health  Activity  is  responsible  for  the  operation  of  a  combined 
psychiatry/psychology/social  work  clinic.  To  further  complicate  the  situation,  all 
nursing  personnel  who  staff  the  clinics  (registered  nurses,  licensed  practical  nurses, 
corpsmen,  and  operating  room  technicians)  are  supervised  and  controlled  by  the 
Chief,  Department  of  Nursing. 

The  purpose  of  this  discussion  is  to  acquaint  the  reader  with  some  of  the 
variables  involved  in  discussing  the  ambulatory  care  facilities  at  DeWitt  Army 
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FIGURE  1 


♦Chief  of  Family  Practice  is  also  the  Director  of  Primary  Care  and  Conmunity  Medicine. 

♦♦These  clinics  are  troop  medical  clinics  in  the  mornings  and  family  practice  clinics  in  the  afternoons. 


Community  Hospital.  The  clinics  are  dispersed,  the  supervision  of  the  clinics  is  not 
centralized,  and  the  types  of  patients  seen  at  each  of  the  clinics  is  slightly 
different  depending  upon  the  speciality  of  that  clinic. 

Current  Ambtjlatory  Quality  Assurance  Activities 

The  current  outpatient  quality  assurance  program  at  DeWitt  is  difficult  to 
define  since  there  is  a  complete  lack  of  direction  and  organization  to  the  process. 
When  approached  on  the  subject,  the  personnel  in  the  clinics  state  that  either  it  is 
not  done  or  some  type  of  medical  chart  review  is  being  conducted.  Those  doing 
chart  reviews  have  no  documentation  of  what  has  been  done,  what  was  found,  or 
what  action  was  taken  to  correct  deficiencies  noted.  The  basic  ground  rules  of  the 
Joint  Commission  on  Accreditation  of  Hospitals  on  quality  assurances 

1.  Problem  focused, 

2.  Objective  assessment, 

3.  Implementation  of  corrective  action, 

4.  Monitoring  of  corrective  action, 

5.  Documentation  of  the  program's  effectiveness,  and 

6.  Cost  effectiveness 

have  not  been  considered  in  performing  what  little  quality  assurance  work  is  being 
accomplished.  There  is  an  exception  to  the  generally  bleak  outpatient  quality 
assurance  picture  at  DeWitt;  that  exception  is  the  Department  of  Family  Practice 
and  the  efforts  in  that  department  are  a  recent  innovation.  A  more  complete 
discussion  of  the  family  practice  department's  program  will  follow. 
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The  management  of  the  hospital  recognized  the  need  to  strengthen  the  quality 
assurance  program  in  the  fall  of  1980.  The  impetus  for  this  concern  was  an 
upcoming  accreditation  visit  by  the  Joint  Commission  of  Accreditation  of  Hospitals 
scheduled  for  April  of  1982.  The  administrative  resident  at  that  time  was  directed 
to  formulate  a  new  QA  plan  which  would  fulfill  the  new  standards  on  quality 
assurance  instituted  by  the  Joint  Commission  on  Accreditation  of  Hospitals  in 
January,  1981.  To  that  end  a  revised  plan  was  developed  (Appendix  A).  The  plan 
encompassed  all  the  facets  of  a  model  plan  which  the  JCAH  outlined  in  the  Manual 
for  Accreditation  of  Hospitals,  dated  1981.  A  review  of  the  plan  reveals  that  an 
organization  for  the  quality  assurance  activity  was  developed.  The  organizational 
structure  was  activitated  prior  to  the  accreditation  and  quality  assurance  projects 
began  to  flow. 

Subsequent  to  the  accreditation  visit  the  flow  of  problems  slowed  to  a  trickle. 
The  reason  for  the  diminution  of  the  process  can  be  linked  to  several  key  factors. 
First  the  plan,  although  technically  correct,  was  not  a  tool  which  the  practitioners 
could  use  as  a  ready  reference.  The  format  for  submitting  problems  (DA  Form 
2496,  Appendix  Q)  required  a  great  deal  of  information,  and  it  was  cluttered.  The 
chart  which  described  the  flow  of  information  (Figure  2)  did  not  present  a  clear 
picture  of  the  quality  assurance  process. 

Another  reason  for  the  failure  of  the  plan  can  be  traced  to  the  management  of 
the  program,  the  Hospital  Executive  Committee.  This  committee  is  composed  of 
the  Hospital  Commander,  the  Executive  Officer,  the  Chief  of  Professional 
Services,  and  the  Chief,  Department  of  Nursing.  The  committee  was  also  to  serve 
as  the  Quality  Assurance  Committee  for  the  institution.  It  became  obvious  quickly 


22 


FLOW  OF  INFORMATION  OF  COMMITTEES 
(Effective  1  January  1981) 
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—  Patient  Care  Auditing  (MCE  Committee) 

—  TAB 

—  Infection  Control 

—  Nursing  Audit 

—  Ambulatory  Care  Committee 

—  Blood  Transfusion  and  Tissue/ 
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— Automation  Guidance  Council 
— Civilian  Training  Committee 
— Crime  Prevention  Council 

—  Disaster  Planning  Corrimittee 

—  Energy  Conservation  Council 
— Health  Consumer  Committee 
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that  the  time  required  to  monitor  the  QA  activities  of  the  hospital  was  too  much 
for  the  committee  to  handle  properly.  The  jolt  which  led  to  that  realization  of  the 
Executive  Committee  was  the  reoccurring  comment  on  all  the  committee  minutes 
reviewed  of, "No  quality  assurance  problems  noted."  This  resulted  in  a  decision  that 
another  structure  had  to  be  developed  to  oversee  the  QA  program. 

In  order  to  reevaluate  the  process  to  establish  a  more  viable  structure, 
meetings  with  the  hospital  hierarchy  were  conducted.  The  results  of  those 
meetings  were: 

1.  The  medical  and  administrative  staff  did  not  want  to  participate  in 
another  committee. 

2.  The  focus  of  the  QA  program  should  be  at  the  departmental  level,  with 
the  department  chief  having  the  decentralized  responsibility  to  conduct  the  QA 
program  at  his/her  level. 

In  order  to  include  the  recommendations  of  the  majority  the  plan  was 
rewritten  (Appendix  C).  The  revision  included  the  formation  of  a  Quality 
Assurance  Coordinating  Committee  to  oversee  the  QA  activities  of  the  hospital.  In 
order  to  not  require  the  staff  of  the  hospital  to  attend  another  committee  meeting 
the  membership  was  limited  to; 

1.  Chief,  Professional  Services  (Chairman), 

2.  Department  of  Nursing  QA  Coordinator, 

3.  Chief,  Inpatient  Branch,  Clinical  Support  Division, 

4.  Risk  Manager,  and 

5.  Administrative  Resident. 
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The  issue  of  departmental  centered  QA  activities  was  included  in  the  plan  by 
specifically  challenging  them  to  develop  a  QA  plan  for  their  organization  and 
requiring  reports  on  their  activities. 

The  revised  plan  did  simplify  the  rei>orting  procedures  and  attempted  to  place 
the  monitoring  responsibility  on  a  committee  (the  QA  Coordinating  Committee) 
which  is  bettor  suited  to  perform  the  detailed  supervision  needed. 

The  quality  assurance  activities  currently  being  performed  in  the  hospital's 
outpatient  activities  are  minimal.  The  Department  of  Family  Practice  is  the 
current  pacesetter  in  performing  outpatient  quality  assurance  studies.  This 
department  has  not  only  the  family  practice  clinic  under  its  control,  but  also  is 
responsible  for  the  troop  health  clinics,  health  clinics  at  Fort  A.P.  Hill  and  Vint 
Hill  Farms  Station,  the  emergency  treatment  room,  the  acute  minor  illness  clinic, 
and  the  flight  surgeons  clinic.  The  department  conducted  a  study  in  the  emergency 
room  on  abrasions.  The  results  of  this  study  (Appendix  D)  show  a  basic 
understanding  of  audit  procedures  but  the  format  for  the  studies  does  not  allow  for 
identification  of  individual  providers  whose  practice  is  unacceptable.  Although  the 
study  was  not  as  complete  as  it  couid  have  been,  it  did  point  out  shortcomings  and 
resulted  in  protocols  and  training  sessions  to  correct  shortcomings.  A  follow-up 
study  (Appendix  E)  did  reveal  some  improvement  in  the  quality  of  care  provided  for 
that  specific  diagnosis. 

The  reason  for  the  family  practice  department's  QA  program  is  not  entirely 
self-motivated  by  the  department's  personnel.  The  department  is  responsible  for 
an  accredited  residency  program  and  in  order  to  fulfill  the  .  ccreditation  standards 
the  department  must  have  a  viable  QA  program.  The  program  does 
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demonstrate  that  a  QA  process  is  ongoing  but  could  be  improved.  The  family 
practice  QA  plan  does  not  directly  address  the  monitoring  of  individual  physician 
practice.  The  identification  of  deficiencies  on  a  departmentai  level  may  be 
inappropriate  if  one  or  two  practitioners  are  responsible  for  the  majority  of  the 
deficiencies.  The  monitoring  of  the  quality  of  care  provided  should  extend  to  the 
individual  physician.  This  is  particularly  true  in  a  teaching  program  if  a  resident's 
ability  is  to  be  objectiveiy  accessed. 

Beyond  the  family  practice  department's  efforts,  the  efforts  of  the  hospital 
are  not  very  effective.  The  quality  of  care  rendered  in  the  Acute  Minor  Illness 
Clinic  (A MIC)  is  required  by  the  program  document  which  prescribes  its 
organization  to  conduct  daily  audits  of  the  enlisted  personnel  who  are  physican 
extenders.2  This  audit  is  to  insure  that  the  extenders  are  complying  with  the 
algorithms  which  prescribe  diagnostic  and  treatment  regiments  for  an  array  of 
common  diagnoses  and  patient  physical  complaints.  This  mandatory  review  of  10% 
of  the  cases  seen  daily  is  excellent  for  insuring  program  maintenance  but  it  does 
not  evaluate  the  efficacy  of  care  other  than  what  is  prescribed  in  the  extenders 
manual. 

The  Ambulatory  Care  Committee  is  comprised  of  providers  of  ambulatory  care 
and  this  committee  conducts  semi-annual  audits  of  outpatient  care.  The  semi¬ 
annual  audits  are  mandated  by  Standard  VI  of  the  JCAH  and  those  audits  are 
conducted  to  fulfill  that  requirement.  The  results  of  those  audits  have  not  been 
widely  disseminated  and  intergrated  into  other  quality  assurance  activities  in  the 
institution. 
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The  Chief  of  Emergency  Services  in  conjunction  with  the  Chief  of  Pediatric 
Service  has  instituted  a  daily  review  of  all  pediatric  patients  seen  in  the  emergency 
room  during  the  previous  evening  and  night.  The  thrust  of  this  review  is  to  survey 
the  appropriateness  of  care  provided  to  the  pediatric  patients  by  the  emergency 
room  staff.  This  review  is  a  result  of  having  a  large  number  of  providers  (mainly 
family  practice  and  civilian  contract  residents)  caring  for  pediatric  patients  in  that 
setting.  This  daily  audit  allows  the  pediatric  staff  to  contact  the  patients  if  they 
feel  that  additional  care  needs  to  be  rendered.  The  shortcoming  with  the  system  is 
that  a  methodology  for  trending  problems  which  are  either  generally  applicable  to 
all  providers  or  are  attributable  to  an  individual  provider  is  needed.  This  lack  of 
feedback  invites  a  constant  repetition  of  the  problems. 

The  Medical  Care  Evaluation  Committee  of  the  hospital  is  responsible  for  a 
number  of  monitoring  activities  associated  with  quality  assurance  and  utilization 
review.  Specific  to  outpatient  care  is  a  chart  review  process  whereby  a  random 
sample  of  approximately  thirty  (30)  records  are  provided  to  each  of  the  major 
departments  (surgery,  medicine  and  family)  as  well  as  pediatrics,  obstetrics  and 
gynecology  service.  The  chief  of  each  of  these  departments/services  conducts  a 
review  of  the  last  visit  annotated  in  the  patient's  record.  There  is  no  criteria  for 
commonality  of  the  record  except  that  the  last  visit  was  in  the  service  within  the 
proceeding  ninty  days.  The  chief  then  reviews  the  chart  based  upon  his  knowledge 
and  reports  findings  to  the  committee  in  a  round  table  fashion.  The  findings  are 
typically  negative.  A  review  of  the  committee  minutes  revealed  a  complete  lack 
of  action  resulting  from  this  type  of  audit. 


Summary  of  Current  Quality  Assurance  Activities 
The  current  outpatient  quality  assurance  process  at  DeWitt  Army  Community 
Hospital  is  not  coordinated.  There  are  clusters  of  outpatient  QA  being  performed, 
but  their  results  are  not  intergrated  into  a  hospital  wide  program.  The  informa^on 
gained  by  one  study  is  not  shared  with  other  providers  in  the  institution.  The 
institution  lacks  a  sense  of  direction  in  the  assurance  of  outpatient  care. 

The  lack  of  direction  is  due  in  part  to  the  inexperience  of  the  professional 
staff  in  performing  QA  studies.  The  retrospection  audits  performed  during  the 
1970's  were  conducted  primarily  by  medical  records  technicians  and  were  basically 
ineffective.  This  frame  of  reference  is  held  by  most  physicians  to  be  what  quality 
assurance  was  and  is,  and  they  do  not  want  to  get  involved.  The  idea  of  starting  an 
audit  process  for  outpatient  care  is  unwelcomed  and  this  feeling,  coupled  with  a 
general  lack  of  knowledge  of  quality  assurance  techniques,  i.e.,  concurrent  audits, 
trending,  generic  audit,  and  process  versus  outcome  audits,  presents  a  significant 
challenge  to  the  hospital  leadership. 

The  solution  to  the  problem  is  not  ordering  the  outpatient  services  to  conduct 
audits  since  this  does  not  solve  the  basic  problem,  a  lack  of  knowledge  of  how  to 
conduct  a  QA  program.  If  the  knowledge  of  how  a  QA  program  is  to  function  was 
understood  by  the  medical  staff  they  probably  would  have  changed  the  format  of 
the  medical  care  evaluation  committee's  monthly  random  audit  procedure.  Instead, 
they  continued  to  perform  the  same  nonproductive  chart  reviews. 

This  study  will  concentrate  on  developing  an  information  network  whereby  the 
individuals  who  are  required  to  conduct  quality  assurance  studies  will  know  where 
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to  find  the  data  necessary  to  do  the  studies.  Additionally,  a  format  for  displaying 
the  data  and  using  appropriate  statistical  tests  to  validate  the  results  of  the  studies 
is  to  be  developed. 
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Footnotes 


l^oint  Commission  on  Accreditation  of  Hospitals,  Manual  for  Accreditation  of 
Hospitals,  (Chicago,  1982). 

^US  Army  Health  Services  Command,  Ambulatory  Patient  Care  Model  //1 3, 
dated  August,  1977,  Fort  Sam  Houston,  Texas. 
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CHAPTER  IV 


IDENTIFICATION  OF  NEEDED  INFORMATION 
Introduction 


Using  the  Joint  Commission  on  Accreditation  of  Hospitals'  standard  on  quality 
assurance  as  the  basis  for  determining  baseline  requirements  of  a  QA  program,  the 
one  element  which  poses  a  significant  challenge  in  fulfilling  was  "cost 
effectiveness".^  In  order  to  show  cost  effectiveness  a  standard  cost-benefit 
analysis  can  be  utilized  to  determine  if  the  outcome  of  a  study  has  resulted  in  a 
decrease  in  expenses  necessary  to  treat  a  particular  medical  complaint  or 
diagnosis.  In  order  to  determine  the  cost  involved  in  conducting  the  study  a  price 
tag  has  to  be  placed  on  all  individual  efforts  involved  in  the  study.  Although  the 
formulation  of  costs  is  not  impossible  It  is  annoying.  Recently,  Army  hospitals 
have  for  the  first  time  attempted  to  identify  personnel  cost  in  order  to  comply 
with  the  Uniform  Chart  of  Accounts  Program. 2  The  effort  necessary  to  assign 
personnel  cost  to  work  centers  based  on  a  precentage  of  time  spent  by  the  work 
force  of  the  institution  in  a  particular  area,  i.e.,  Ophthamology  Clinic,  versus 
inpatient  care  for  the  Ophthamologist.  This  system  has  provided  no  benefits  to  the 
hospital. 

The  InterQual  Corporation  which  has  consulted  with  many  hospitals  on 
establishment  of  quality  assurance  programs  speaks  repeatly  of  the  QA  department 
in  conducting  many  of  the  data  collection  tasks  and  cost  identification 
responsibilities  inherent  in  quality  assurance. ^  The  current  policy  of  the  Army  is 
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that  no  personnel  positions  will  be  recognized  exclusively  for  quality  assurance. 
Without  an  administrative  element  to  perform  the  tedious  work  of  identifying  the 
costs  and  benefits  of  a  quality  assurance  study  that  responsibility  would  fall  on  the 
professional  service  conducting  the  study.  The  result  is  that  concurrent  with 
determining  what  medical  implications  are  to  be  rectified  by  the  study  is  the 
responsibility  to  show  a  positive  monetary  outcome.  At  this  juncture  the 
professional  aspects  of  quality  assurance  are  difficult  to  communicate  to  the 
professional  staff  and  to  compound  the  problem  by  adding  a  financial  aspe  t  might 
be  overwhelming  to  the  staff. 

An  alternative  to  cost-benefit  analysis  is  a  systematic  approach  to  reviewing 
the  effectiveness  of  care  provided  to  the  most  common  diagnosis/patient  medical 
complaints.  The  hospital  cared  for  437,826  patients  in  the  ambulatory  care  setting 
during  the  last  year.^  In  order  to  determine  the  most  prevalent  diagnosis/chief 
complaint  a  survey  was  conducted  for  a  one  week  period  in  four  large  outpatient 
activities.  The  activities  were;  (1)  Obstetrics  and  Gynecology  Clinic,  (2)  Acute 
Minor  Illness  Clinic,  (3)  South  Post  Health  Clinic,  and  (4)  Family  Practice  Clinic. 
These  clinics  were  selected  because  they  are  active  and  together  represent  a  cross 
section  of  the  patient  population  treated. 

The  survey  document  (Appendix  F)  required  the  clinic  personnel  to  catagorize 
the  chief  complaint  the  patient  expressed  to  the  individual  who  initially 
interviewed  the  patient  and  log  the  diagnosis  after  the  visit.  The  tabulation  of  the 
data  provides  the  clinic  chief  an  assessment  of  the  variety  of  ailments  and 
diagnoses  treated  in  that  particular  setting.  The  results  of  the  survey  are  depicted 
in  Figures  3.1,  3.2,  3.3,  3.4. 
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FIGURE  3.1 
FIGURE  3.2 
FIGURE  3.3 
FIGURE  3.4 


RESULTS  OF  CHIEF  MEDICAL  COMPLAINT/DIAGNOSIS  SURVEY 

South  Post  Health  Clinic 
Acute  Minor  Illness  Clinic 
Family  Practice  Clinic 
OB/GYN  Clinic 


FIGURE  3 
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SOUTH  POST  HEALTH  CLINIC 


10  Most  Frequent  Medical 

Complaints  and  Diagnoses 

CHIEF  COMPLAINT  (Reason 

for  Patient  Presenting) 
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Total  for  the  top  10 

122 
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Common  Cold 

8 

2.8 

Total  for  the  top  16 
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AMIC 

10  Most  Frequent  Medical  Complaints  and  Diagnoses 
CHI EF  COMPLAINT  (Reason  for  Patient  Presenting) 


DESCRIPTION 

ACTUAL  f 

Muscle  Skeletal  Pain 

46 

14.7 

Sore  Throat 

31 

9.9 

Cough 

31 

9.9 

Follow-Up 

22 

7.0 

Rash 

19 

6.0 

Flu  Symptoms 

13 

5.8 

Congestion 

15 

4.8 

LBD 

15 

4.8 

Earache 

13 

4.2 

Eye  Pain 

10 

3.2 

tal  for  the  top  10 

220 

70.3 

■^Total  Useable  Gbservutior.s  313 


Diagnoses  (Dispositions) 


Referred 

28 

9.8 

Allergy  Rhinitis 

20 

7.0 

Sinisitis 

19 

5.6 

Bronchitis 

16 

5.6 

Flu  Syndrome 

15 

5.3 

LBD 

10 

3.5 

Tendonitis 

9 

3.2 

URI 

8 

2.8 

Pharengitis 

8 

2.8 

Viral  Syndrome 

8 

2.8 

ital  for  the  top  10 

141 

49.3 

*Total  Useable  Observations  286 


*The  clinic  surveyed  a  total  of  343  patients,  the  total  number  of  observations  listed 
under  complaints  and  diagnoses  refers  to  the  number  of  useable/i denti fiable  entries 
isj-'  s"-;se  cate'iories. 
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FAMILY  PRACTICE  CLINIC 
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10  Most  Frequent  Medical  Complaints  and  Diagnoses 
CHIEF  COMPLAINT  (Reason  for  Patient  Presenting) 


DESCRIPTION 

Follow-up  Appointment 

Physical  Exam 

Pap  Smears 

FI u-Symptcms 

Ear  Ache 

Back  Pain 

High  Blood  Pressure 
Routine  08  Visit 
Ear  Infection  Follow-Up 
Well  Baby  Check-Up 
Total  for  the  top  10 

notal  Useable  Observations 


ACTUAL  # 

24 

12 

11 

11 

10 

8 

7 

6 

5 

5 
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15.6 

7.8 
7.1 

7.1 

6.5 

5.2 

4.5 

3.9 

3.3 
3.3 

66.0 
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Diagnoses  (Dispositions) 


Pregnancy 

Physical  Exam  .  ^  ^ 

Hypertension 

L30 

Serous  Otitis 
Otitis  Media 
Sinus  Infection 
Diabetic 
Well  Baby  Check 
Vaginitis 
Anemi a 

Routine  OB  Visit 
Total  for  the  top  12 

*Tota1  Useable  Observations 


12 

12 

10 

7 

7 

7 

5 

4 

4 

4 

4 

4 
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7.7 

7.7 

6.5 

4.5 
4.5 

4.5 
3.2 

2.6 
2.6 
2.6 
2.6 
2.6 

51.6 
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riinir  mirv^^ved  a  total  of  103  patients,  the  total  number  of  observations  list 
unter  IwLlnlfd  di5?nos6s  refer?  to  the  robber  of  eseable/identif.eble  entries 

tor  Lhose  categories. 
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unidentifiable  by 

the  clinic 

RANK 

DESCRIPTION 

ACTUAL  4 

1 

03  Routine 
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33.6 

2 

Follow-Up  Appt 

61 

13.2 

3 

Pap  Smear 

39 

8.5 

4 

Vag  Infection 

32 

6.9 

5 

Problem  GYN  -? 

27 

5.9 

6 

Preg  Test 

22 

4.8 

7 

Lower  Abdominal  Pain 

20 

4.3 

3 

BCr  Refill 

18 

3.9 

3 

Vaginal  Bleeding 

18 

3.9 

10 

lUD 

8 

1.7 

10 

Colpo 

8 

1.7 

Total  for  the  top  11 

408 

83.5 

*Total  Useabl?  Observations  461 


nhe  clinic  surveyed  a  total  of  504  patients,  the  total  number  of  observations  listed 
under  complaints  and  diagnoses  refers  to  the  number  of  useable/identifiable  entries 
for  those  categories. 
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From  this  information  a  plan  can  be  developed  for  performing  studies  to  insure 
the  quality  of  care  provided  in  the  clinic  setting  based  on  the  prevalence  of  the 
diagnosis/chief  complaint.  The  cost  effective  issue  is  addressed  not  from  a  cost- 
benefit  approach  but  from  the  common  sense  approach  that  if  studies  are  to  be 
conducted  they  should  be  aimed  at  ti.ose  issues  which  effect  the  greatest  number 
of  patients.  The  prevalence  of  a  diagnosis  or  complaint  is  not  the  only  criteria 
which  can  be  used  in  determining  what  should  be  investigated.  Findings  by  other 
services  may  highlight  a  gross  need  for  action.  An  investigation  of  inappropriately 
requested  radiographic  studies  by  the  radiology  department  may  be  a  priority 
matter  from  the  headquarters  point  of  view  and  therefore  that  study  may  be 
mandated.  Or  if  an  influx  of  return  patients  are  seen  for  a  particular  diagnosis 
which  should  not  result  in  return  visits,  the  clinic  chief  may  want  to  direct  efforts 
to  identify  the  probiem  and  take  corrective  action.  The  rank-order  assessment  of 
diagnosis/chiof  complaint  provide?  the  clinicians  with  a  logical  basis  to  formulate  a 
QA  plan  in  the  absence  of  other  stimulus. 

To  carry  the  survey  of  the  clinics  to  all  thirty-seven  clinics  in  the  hospital 
would  provide  the  institution  a  snapshot  of  what  types  of  compiaints  and  diagnoses 
are  seen  by  the  hospital  on  the  aggragrate.  Again  referring  to  the  3CAH  standard 
on  quality  assurance  a  requirement  for  hospital-wide  priorities  is  required.^  A 
compilation  of  totai  number  of  patients  seen  for  a  specific  diagnosis  in  all  clinics 
would  provide  a  basis  for  decision  making  on  assignment  of  priorities  for  the 
hospital  leadership. 

The  literature  constantly  refers  to  an  elaborate  listing  of  sources  for 
identification  of  quality  assurance  problems. 6,  7  The  list  encompasses: 


1.  Utilization  Review  Data, 

2.  Morbidity  Review, 

3.  Mortality  Review, 

Tissue  Review, 

5.  Antibiotic  Committee  Results, 

6.  Therapeutics  Agents  Board  Results, 

7.  Blood  Utilization  Committee, 

8.  Infectious  Disease  Committee, 

9.  Unusual  Occurance  Report, 

10.  Safety  Committee, 

11.  Outside  Audit  Agencies,  i.e.,  JCAH,  Army  Audit  Agency,  General  Accounting 
Office, 

12.  Credentials  Committee,  and 

13.  Etc. 

Interviews  conducted  with  the  professional  staff  of  the  hospital  revealed  that 
many  of  the  above  listed  sources  of  information  are  not  being  used  to  formulate 
quality  assurance  studies.^*  ^  The  reason  for  this  lack  of  action  is  in  part  due  to  a 
iack  of  demand  to  conduct  quality  assurance  studies.  As  mentioned  earlier,  only  in 
anticipation  of  the  accreditation  visit  by  the  Joint  Commission  on  Accreditation  of 
Hospitals  did  the  flow  of  quality  assurance  studies  begin.  Since  the  time  of  the 
survey  (June,  1981)  to  the  present  only  five  quality  assurance  studies  have  been 
instituted.  10  Of  the  five  studies  instituted  three  are  applicable  to  the  outpatient 
setting. 
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A  review  of  committee  minutes  of  the  tissue,  infectious  disease  control,  blood 
utilization,  and  morality  and  morbity  committees  showed  that  a  standard  agenda  is 
followed  and  the  results  are  predictable.  Variations  noted  in  the  discussion  are 
explained  and  typically  no  recommendations  are  made  concerning  problems  noted. 
In  order  to  correct  this  situation  guidance  to  the  committee  chairmen  mandating 
problem  identification  is  needed.  The  chief  of  emergency  medical  services  stated 
that  it  would  be  helpful  in  formulating  studies  to  have  more  information  from  the 
laboratory  on  problems  which  the  laboratory  has  from  his  department.  During  a 
follow-up  interview  with  Major  Ridenour,  Assistant  Chief,  Department  of 
Pathology,  Dr.  Ridenour  stated  that  it  is  pos'.  '  le  for  his  department  to  identify 
trends  in  apparent  inappropriate  use  of  laboratory  tests.  12  This  failure  in 
communication  is  due  to  a  lack  of  a  concentrated  effort  on  the  part  of  various 
departments  and  services  to  surface  problems. 

The  professional  staff  of  the  outpatient  clinics  requires  Information  not  only 
on  what  types  of  patients  they  treat  but  also  needs  to  know  how  the  treatment  of 
patients  affects  other  activities  within  the  hospital.  In  an  effort  to  correct  this 
situation  the  revised  hospital  quality  assurance  (Appendix  C)  has  placed  an 
emphasis  on  departmental/separate  service  quality  assurance  activities.  By 
requiring  separate  services  and  departments  to  report  their  quality  assurance 
efforts  monthly  to  the  Quality  Assurance  Coordinating  Committee  a  portal  for 
expression  of  both  intra  and  interdepartmental  problems  is  open.  The 
identification  of  a  problem  in  other  services  via  the  interdepartment  problem 
identification  format  will  lead  to  increased  interaction  between  departments.  A 
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collegiality  must  exist  among  staff  members  to  effectively  deal  with  these  types  of 
problems.  Heretofore  waiting  for  staff  members  to  voluntarily  identify  problems 
has  not  resulted  in  any  action.  In  observing,  the  author  has  noted  that  the  majority 
of  interdepartmental  action  has  arisen  from  incidents  which  were  possibly 
disastrous.  The  responses  are  normally  hasty  and  although  the  results  may  be  a 
perfect  solution,  having  to  await  a  crisis  to  correct  a  problem  is  not  the  ideal 
situation. 

The  mandate  of  the  revised  hospital  quality  assurance  program  to  identify 
problems  on  a  regular  basis  will  provide  the  information  needed  for  clinic  chiefs  to 
more  effectively  deal  with  the  intent  of  quality  assurance. 

> 

In  addition  to  the  internal  patient  profile  and  problems  identified  by  other 
services/departments  there  are  other  types  of  information  required  for  the  clinic 
to  formulate  a  quality  assurance  plan  of  action.  Although  the  interviews  with 
clinic  chiefs  did  not  reveal  a  desire  for  this  information,  the  need  for  it  is 
documented  in  the  literature.  Dr.  Stanley  Skillicorn  in  his  book,  Quality  and 
Accountability,  elaborates  on  the  need  to  identify  problems  from  both  official  and 
unofficial  sources.  The  official  sources  are  comprised  of  all  those  pieces  of  paper 
which  make  their  way  through  the  hospital  such  as  necessary  reports,  statistical 
summaries,  and  minutes  of  meetings.  Those  documents  include  many  important 
facts  which  can  pinpoint  quality  assurance  problems.  In  addition  to  all  those 
official  sources  are  the  complaints/comments  of  staff  members,  patients  and 
visitors  to  the  institution. 

The  problem  with  unofficial  information  is  capturing  it.  At  some  point  an 
individual  has  to  pinpoint  the  problem  and  communicate  the  concern  to  an 
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individual  who  will  act  on  it.  Verbalizing  the  problem  is  not  adequate.  At  some 
junction  the  unofficial  information  has  to  be  transformed  into  writing  whereby  it 
becomes  official.  At  the  present  time  patient  complaints  are  transmitted  to  the 
patient  representative  via  spoken  work  or  in  writing.  In  either  case  the  complaint 
is  eventually  recorded  on  a  "Concerned  Care  Comment  "  (Appendix  G). 

The  complaints  are  handled  on  an  individual  basis  with  a  written  reply 
ultimately  being  sent  to  the  patient.  The  total  number  of  complaints  are 
catagorized  monthly  and  are  used  as  the  basis  for  a  monthly  report  (Appendix  H). 
The  reports  are  reviewed  by  the  hospital  staff  and  the  resultant  action  has  been 
sporatic.  Changes  resulting  from  the  report  have  been  made  in  the  areas  of  patient 
waiting  times  in  the  emergency  treatment  room  and  pharmacy.  Also  several 
indepth  studies  of  the  central  appointment  system  have  been  conducted.  The 
concerns  patients  have  conveyed  are  acted  upon  at  least  individually  and  in  a 
number  of  areas  changes  have  been  enacted.  Even  though  improvement  has 
occurred  additional  emphasis  on  the  system  could  be  even  more  productive. 

The  patient  advocate  has  given  the  patient  a  voice  in  formulating  policy 
change  but  the  staff  lacks  a  similar  conduit  to  express  concerns.  In  order  to 
rectify  this  situation  a  system  for  individual  expression  of  possible  quality 
assurance  problems  needs  to  be  defined.  The  form  included  in  the  revised  hospital 
quality  assurance  plan  (Appendix  1),  MEDDAC  Form  522,  Quality  Assurance 
Program  Problem  Assessment  Worksheet  has  the  potential  to  allow  individual 
initiation  of  problem  identification.  The  solicitation  of  individual  initiatives  needs 
the  support  of  the  hospital  leadership.  A  nonretrobution  policy  needs  to  be 
extended  to  those  who  step  forward  to  reveal  a  problem.  An  open  invitation  to  all 
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staff  members  to  provide  input  to  the  program  will  bring  forth  both  sound  and  not- 
so-sound  problems.  The  handling  of  the  not-so-sound  problems  requires  tact  on  the 
part  of  the  quality  assurance  chairman.  Positive  reinforcement  of  tliose  who 
contribute,  no  matter  how  mundane  the  subject,  should  be  the  tenor  of  the 
hierachy. 

Identification  of  Data  Sources 

The  discussion  with  the  clinicians  in  the  outpatient  setting  revealed  a  need  for 
more  complete  Information  in  order  for  them  to  assess  the  quality  of  care 
provided.  Determining  where  the  needed  information  can  be  derived  is  the  next 
order  of  business.  The  initial  source  of  possible  information  was  the  Patient 
Administration  system  and  Biostatistical  Agency,  (BIOSTAT  Agency)  US  Army 
Health  Services  Command,  Fort  Sam  Houston,  Texas.  The  BIOSTAT  Agency  is  the 
single  manager  for  all  automated  biostatistical  information  for  the  US  Army.^^ 
This  organization  compiles  a  tremendous  volume  of  Information  on  patients  treated 
by  any  Army  hospital.  But  a  discussion  with  Lieutenant  Colonel  Author  Badgett, 
Chief,  Biostatistics  Division  of  the  agency  revealed  that  the  vast  majority  of  the 
information  captured  is  on  patients  admitted  to  the  hospital.  The  only  data 
available  on  outpatients  is  the  number  of  clinic  visits  and  the  catagory  of 
beneficiary,  i.e.,  active  duty,  dependent  of  active  duty,  retiree,  etc.  The  data 
available  at  the  BIOSTAT  Agency  was  also  locally  available  and  did  not  appear  to 
be  helpful. 

LTC  Badgett  recognized  the  lack  of  automated  information  as  a  problem  in 
monitoring  quality  assurance.  At  the  current  time  experiments  are  being 
conducted  at  various  Army  hospitals  to  determine  if  it  will  be  feasible  in  the  future 


to  capture  outpatient  treatment  data.  The  high  volume  of  outpatient  visits  which 
take  place  daily  within  the  Army  is  making  this  task  extremely  difficult.  LTC 
Badgett's  prognosis  for  automatic  support  in  outpatient  services  is  not  optimistic. 
The  time  required  to  bring  the  experimental  models  into  actuality  is  an  excess  of 
five  years.  Obviously  the  quality  assurance  program  cannot  wait  for  automated 
data  collection. 

Without  support  from  the  BIOSTAT  Agency  the  hospital  will  have  to  rely  on 
data  which  is  locally  available.  The  heart  of  the  hospital  data  collection  is  the 
Patient  Administration  Division.  The  Patient  Administration  Division  has  the 
responsibility  for  maintenance  of  all  health  records  of  patients  treated  at  the 
hospital.  Currently  the  division  is  maintaining  in  excess  of  75,000  outpatient 
records,  Army  outpatient  health  records  are  maintained  in  a  chronological 
sequence,  the  most  recent  encounter  is  the  last  entry  In  the  record  and  is  the  top 
document  in  the  file.  The  size  of  the  health  record  depends  on  the  number  of  times 
the  patient  has  been  treated.  The  record  is  perpetual,  the  same  records  can 
contain  forty  years  worth  of  data.  The  only  time  an  outpatient  health  record  is 
retired  is  when  the  patient  has  not  been  seen  within  the  last  three  years.  Even  if 
the  record  is  retired  it  is  forwarded  to  the  records  storage  area  in  St.  Louis,  Ill  and 
held  for  fifty  years.  15  The  outpatient  medical  record  is  the  single  most  valuable 
source  of  information  in  the  institution.  The  evaluation  of  the  quality  of  care  is 
determined  from  the  notes  made  by  the  provider  in  conjunction  with  the  results  of 
tests  performed.  Since  the  completeness  of  the  record  is  the  key  factor  considered 
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in  evaluating  the  quality  of  care  by  the  3oint  Commission  the  record  should  also  be 
the  primary  focus  of  local  quality  assurance  activities. 

The  outpatient  health  record  contains  many  different  types  of  data.  The  most 
common  elements  of  the  outpatient  record  include:  laboratory  results,  x-ray 
results,  copies  of  physical  examinations,  summaries  of  inpatient  episodes,  and 
narrative  descriptions  of  outpatient  visits.  The  quality  of  the  content  of  the  record 
is  dependent  on  all  the  individuals  who  contribute  to  the  many  inputs  which 
constitute  the  body  of  the  record.  The  laboratory  and  other  departments  are 
responsible  for  insuring  that  copies  of  all  tests  are  forwarded  to  the  outpatient 
records  for  posting  to  the  record.  After  receiving  the  test  results,  the  records 
technicians  post  the  results  to  the  record.  Herein  lies  a  tremendous  problem.  In 
order  to  post  results  the  record  has  to  be  in  the  records  room.  The  completeness  of 
the  record  is  dependent  upon  all  the  facts  of  the  process  being  in  coordination;  if 
any  one  of  the  components  of  the  system  faiis,  the  resuit  is  an  incompiete  record. 

The  laboratory,  pharmacy  and  radiology  departments  each  maintain  individual 
records  of  their  portion  of  a  patient  encounter.  Individual  copies  of  each 
laboratory  test  are  maintained  by  the  Department  of  Pathology  and  the 
Department  of  Radiology.  The  pharmacy  maintains  copies  of  all  prescriptions 
filled  in  that  service.  These  copies  provide  the  chief  of  each  of  those  services  a 
key  to  assessing  the  quality  of  services  provided  and  the  appropriateness  of 
requested  tests  or  prescriptions. 
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The  Patient  Administration  Division,  as  mentioned  eariier,  maintains  the 
medicai  records  for  patients  treated  at  the  hospitai.  Aside  from  the  valuable 
information  contained  in  those  records,  the  most  important  information  which  the 
division  can  provide  is  the  completeness  of  the  record.  Because  of  its 
responsibility  to  pass  all  information  to  the  record  the  Patient  Administration 
Division  is  most  capable  of  assessing  the  status  of  the  composition  of  the  record. 
The  biggest  issue  in  assessing  outpatient  care  is  the  availability  of  the  record.  The 
avaiiability  of  a  record  can  be  attributed  to  a  variety  of  problems.  There  are 
problems  with  individual  patients  maintaining  their  own  record,  clinics  may  not 
promptly  return  records,  and  the  record  can  be  misplaced.  Any  one  of  these 
situations  can  seriously  affect  the  ability  to  conduct  audits  and/or  studies.  In  order 
to  have  a  viable  program  the  Patient  Administration  Division  will  have  to  be  able 
to  support  the  audit  procedures  and  to  that  end  the  most  important  data  the 
division  can  provide  is  on  the  administrative  actions  required  to  maintain  the 
complete  outpatient  health  record.  Specific  data  should  include  time  required  for 
clinics  to  return  records  after  a  patient  appointment,  percent  of  records  not 
maintained  in  the  outpatient  records,  total  number  of  test  results  for  which  a 
medical  record  has  to  be  constructed,  and  other  measurements  of  completeness  of 
the  outpatient  medical  record. 

The  Uniform  Chart  of  Accounts  Branch  of  the  Comptroller  Division  amasses  a 
tremendous  amount  of  data  regarding  the  operation  of  the  hospital.  The  problem 
with  the  data  they  compile  is  that  it  is  not  useful  to  the  management  of  the 
hospital  in  decision  making.  Although  the  results  of  the  sophisticated  step  down 
cost  apportionment  method  does  not  provide  a  usable  end  product,  the  data  base 
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upon  which  the  system  is  based  is  a  handy  resource  to  the  organization.  With  very 
little  effort  the  Uniform  Chart  of  Accounts  Branch  can  provide  an  extract  of 
almost  any  type  of  data  a  manager  would  need  to  evaluate  the  cost  of  operating  a 
service  and  also  the  amount  of  workload  generated  by  that  service. 

The  nature  of  the  Uniform  Chart  of  Accounts  Office  is  such  that  it  would  be 
inappropriate  to  expect  problems  to  be  identified  by  it.  The  data  bank  should  be 
used  as  a  resource  in  confirming,  analyzing  and  evaluating  problems  which  involve 
resources.  By  soliciting  historical  data  from  the  Uniform  Chart  of  Accounts  Office 
the  person  conducting  the  study  may  be  able  to  gather  more  complete  information 
upon  which  to  judge  his/her  decision. 

Methods  of  Extracting  Data 
Defining  Data  to  be  Extracted 

The  extraction  of  data  which  will  be  used  in  the  outpatient  quality  assurance 
program  will  have  to  be  primarily  done  manually.  The  hospital  is  totally  lacking  in 
automation  in  the  primary  care  setting.  As  discussed  earlier  the  Patient 
Administration  and  Blostatistlcai  Agencies  do  not  capture  any  data  in  the 
outpatient  setting  except  for  workload  and  a  very  limited  number  of  diseases  which 
are  reported  for  public  health  reasons.  The  lack  of  automated  data  banks  does  not 
mean  that  data  is  utiobtainable.  The  key  to  data  collection  is  to  determine  at  what 
point  in  the  patient  encounter  or  after  the  encounter  the  data  collection  should 
take  place.  In  order  to  determine  the  optimal  point  to  collect  the  data  some 
preliminary  decisions  have  to  be  made.  The  subject  or  focus  of  the  study  needs  to 
be  determined;  the  focus  may  be  on  a  diagnosis,  a  chief  medical  complaint,  a 
category  of  patient  (age,  sex,  race,  etc.),  a  particular  laboratory  test,  an 
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administrative  procedure,  or  the  patient's  food.  After  the  subject  is  selected  the 
next  decision  is  what  is  to  be  measured,  counted,  examined,  or  compared  by  the 
data  collector.  This  needs  to  be  clearly  defined  to  insure  consistent  results.  The 
data  to  be  collected  may  be  as  simple  as  the  weight  of  male  patients  over  40.  But 
any  data  element  which  requires  interpretation  may  not  be  valid;  a  request  that  the 
data  collector  "determine  whether  a  lab  test  was  appropriate  based  on  the  patient 
history",  requires  more  definite  guidance.  The  data  collector  must  have  very  clear 
guidance  in  order  to  effectively  perform  his/her  task. 

Sampling  Considerations 

Assuming  that  the  subject  is  well  defined  and  the  data  to  be  collected  is 
clearly  delineated,  the  next  question  is  how  much.  How  much  data  needs  to  be 
collected  is  a  very  difficult  problem  to  address.  There  are  several  principles  of 
which  the  individual  conducting  a  study  should  be  aware.  The  first  matter  to  be 
addressed  is  population  size. 

The  population  size  is  the  number  of  items  which  are  the  subject  of  the  study, 
If  the  population  to  be  studied  is  those  patients  wlio  are  treated  in  the  emergency 
treatment  room  in  1981,  that  number  may  well  be  50,000.  Conversely,  an  audit  of 
gunshot  patients  seen  in  the  same  clinic  may  represent  only  twenty  incidents.  If 
the  population  is  small  a  complete  audit  of  all  encounters  may  be  possible  and  that 
audit  will  be  very  accurate.  It  is  more  likely  that  the  audit  will  be  on  a  large 
population,  and  therefore  sampling  techniques  are  necessary. 

If  a  sample  needs  to  be  taken  of  the  population  there  are  certain  principles 
that  must  be  observed.  Randomness  of  the  sample  is  the  key  to  arriving  at  a  true 
picture  of  the  population.  Two  conditions  must  be  met  to  achieve  randomness:  (1) 
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all  observations  must  come  from  the  same  population,  and  (2)  the  sample 
observations  must  be  statistically  independent.^^ 

The  first  condition  is  met  by  adhering  to  the  criteria  discussed  earlier 
regarding  clear  identification  of  the  subject  of  study.  The  independence  of  the 
observation  is  based  upon  the  point  that  the  observations  should  stand  alone  and 
their  selections  should  not  change  the  value  of  other  possible  observations. 

The  problem  of  randomness  needs  to  be  discussed  further.  If  the  sample  is  to 
be  a  valid  reflection  of  the  population  an  idea  of  what  the  population  looks  like  is 
necessary.  The  sample  should  be  comprised  of  all  elements  of  the  population  or  at 
least  all  elements  of  the  population  must  have  an  equally  likely  possibility  of  being 
selected.  Elements  of  the  population  may  be  excluded  from  the  sample  for 
seemingly  obvious  reasons  in  retrospect.  If  "stat  lab  test"  is  to  be  sampled,  the 
sample  should  provide  all  requestors  of  "stat  lab  test"  to  be  included.  Limiting  the 
time  frame  for  data  collection  so  that  certain  activities  will  be  excluded  will  taint 
the  results.  If  the  data  collection  is  conducted  on  Tuesday  and  several  clinics  do 
not  operate  on  Tuesdays,  then  those  clinics  will  not  have  the  opportunity  to  be 
represented.  In  determining  the  data  collection  scheme  the  individual  conducting 
the  study  should  be  cognizant  of  the  potential  of  excluding  population  data. 

Following  the  evaluation  of  how  the  sample  is  to  be  done  to  insure  randomness 
and  independence,  the  size  of  the  sample  needs  to  be  determined.  Sample  size  is 
dependent  upon  the  cost  of  the  sampling,  the  timeliness  of  the  sample,  and  the 
accuracy  desired.  Cost  is  significant  in  any  sample;  the  time  and  effort  required  to 
collect  the  sample  information  should  be  reviewed  before  undertaking  a  quality 
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assurance  study.  A  very  short  sample  collection  period  will  reduce  the  size  of  the 
sample.  The  desired  accuracy  of  the  final  result  must  be  taken  into  consideration. 

The  results  of  sample  generally  becomes  more  accurate  as  the  size  of  the 
sample  increases.  Of  course,  as  the  size  of  the  sample  increases  the  cost  of  the 
study  increases  and  the  timeliness  of  the  study  decreases.  The  decision  on  which  of 
these  three  factors  is  the  most  important  is  solely  that  of  the  individual  who  will 
have  to  make  decisions  based  on  the  results.  There  is  no  magic  number  which  an 
individual  can  point  to  and  say  that  is  the  minimum  acceptable  sample  size.  The 
central  limit  theorem  stipulates  that  with  a  large  n  (sample  size  of  30)  the 
theoretical  sampling  distribution  of  Y  (mean  or  average)  can  be  approximated  by 
the  normal  curve.  18  This  theorem  is  the  basis  for  many  statistical  tests  and 
therefore  the  number  30  is  a  valid  milestone  if  the  individual  conducting  the  study 
plans  to  use  statistical  tests  based  on  the  central  limit  theorem. 

The  vast  array  of  other  statistical  tests  which  can  be  used  in  evaluating  study 
results  are  not  based  on  the  "large  n"  of  the  central  limit  theorem.  To  use  30  as  a 
guide  may  result  in  incomplete  data  for  other  tests  of  significance.  To  circument 
the  possibility  of  either  having  too  nr.uch  or  too  little  data  the  literature  should  be 
consulted  prior  to  data  collection  to  ascertain  what  sample  size  would  provide 
adequate  information  for  the  statistical  test  to  be  used. 

Developing  a  Quality  Assurzmce  Study 

The  practical  application  of  sampling  techniques  and  statistical  tests  is  the 
next  step  in  conducting  a  quality  assurance  study.  The  types  of  data  maintained  by 
the  pharmacy,  laboratory,  and  radiology  departments  can  provide  the  users  of  their 
services  valuable  feedback  on  the  appropriateness  of  care  received  for  these 
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services.  Each  of  these  services  maintains  copies  of  the  tests  performed  on  the 
patient  or  in  the  case  of  the  pharmacy  the  prescription  is  filed  in  the  pharmacy. 
These  services  also  have  a  unique  problem  in  evaluating  the  appropriateness  of  the 
service  provided  because  they  normally  do  not  have  the  opportunity  to  see  the 
patient's  medical  record.  The  patient  normally  arrives  at  one  of  these  services 
with  only  a  copy  of  the  request  for  a  procedure  or  prescription.  The  procedure 
request/prescription  has  very  limited  patient  Information  beyond  basic 
identification  data.  This  lack  of  information  necessitates  that  these  services  rely 
on  the  outpatient  record  department  to  collect  the  records  of  patients  involved  in 
an  audit.  The  retrieval  rate  on  requested  patients  records  by  the  outpatient 
records  department  is  approximately  50%  based  on  monthly  audits  of  narcotic 
documentation  audits  conducted  in  the  past  year.^^  This  low  retrieval  rate  has  to 
be  anticipated  by  the  service  conducting  the  audit.  If  a  sample  of  50  records  is 
needed  the  service  should  Identify  100  records  for  retrieval. 

The  steps  involved  in  conducting  an  audit  by  one  of  the  services  which  is 
designated  to  assess  the  appropriateness  of  a  procedure  is  as  follows: 

1.  Determine  the  procedure  to  be  audited.  This  selection  process  can  be  based 
on  cost,  sudden  increase  in  number  of  tests  performed,  possible  delitarious  patient 
effects,  identification  of  problems  involved  with  the  procedure  by  hospital  staff  or 
patients,  or  any  other  problem  identification  process. 

2.  Establishment  of  audit  criteria.  The  criteria  should  be  explicit  and 
thoroughly  understood  by  those  who  will  conduct  the  audit.  The  criteria  should  be 
acceptable  to  the  staff  who  order  the  procedure. 
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3.  Determine  the  compliance  level  which  will  be  standard  for  evaluating  the 
audit  results.  The  establishment  of  a  compliance  of  100%  will  almost  assure  an 
unfavorable  outcome,  if  a  compliance  rate  of  90%  or  85%  is  acceptable, 
consideration  should  be  given  to  setting  a  standard  less  than  100%. 

4.  Select  the  statistical  test  which  will  allow  a  valid  conclusion  to  be  drawn  on 
whether  the  audit  results  meet  the  compliance  goal.  A  more  complete  discussion 
on  selection  of  a  statistical  test  is  in  the  next  chapter. 

5.  Determine  the  sample  size  which  is  necessary  to  gather  sufficient  data  to 
conduct  the  statistical  test.  A  reminder  that  if  records  must  be  retrieved  from 
the  outpatient  records  area  the  retrieval  rate  is  approximately  50%  and  therefore 
the  number  of  records  requested  should  be  proportionally  increased. 

6.  Identify  the  records  to  be  audited.  The  laboratory  and  radiology  copies  of 
test  results  provide  the  key  to  identification  of  the  patients  to  be  audited.  For 
pharmacy  the  prescription  form  also  provides  the  same  information.  In  selecting 
the  records  to  be  audited,  the  randomness  of  the  selection  process  must  be  insured. 
The  outpatient  record  branch  must  have  both  the  patient^  name  and  social  security 
number  to  be  able  to  locate  the  record. 

7.  Conduct  the  audit.  The  actual  performance  must  be  measured  against  the 
criteria  and  recorded  on  a  worksheet.  Confidentiality  of  the  patient  and  the 
provider  must  be  insured.  This  can  be  accomplished  by  using  a  code  to  identify  the 
provider,  assigning  numbers  is  acceptable.  The  last  four  numbers  of  the  patient's 
social  security  number  is  adequate  identification  of  the  patient.  A  key  which  lists 
the  patients'  names  and  social  security  numbers,  as  well  as  the  provider  and  his 
code  number  should  be  safeguarded  by  the  official  conducting  the  audit.  An 
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example  of  a  worksheet  is  in  the  following  chapter. 

8.  Perform  the  statistical  test.  The  statistical  test  will  provide  a  statistical 
basis  for  evaluating  the  actual  clinical  practice  of  the  population  of  Interest  as 
measured  against  the  criteria. 

9.  Draw  conclusions  based  on  the  statistical  results.  If  the  results  are  obvious, 
either  good  or  bad,  the  conclusions  can  be  drawn  quickly.  The  results  may  not  be 
clear.  A  judgement  of  whether  the  statistical  significance/insignificance  also 
represents  practical  significance/insignificance  will  have  to  be  made  by  the 
individual  reviewing  the  results.  A  statistical  significant  result  may  not  present  a 
problem  in  the  practical  sense.  The  conclusion  should  address  both  the  statistical 
and  practical  significance  of  the  findings. 

10.  Develop  recommendations.  If  the  findings  Indicate  problems> 
recommendations  for  resolution  of  those  problems  need  to  be  developed.  If  the 
actions  to  correct  the  problems  are  outside  the  department  then  the  individuals 
who  do  have  the  authority  to  enact  the  action  must  do  so.  The  information  flow 
outlined  in  the  hospital  quality  assurance  plan  (Figure  4)  would  have  the 
recommendations  going  to  the  quality  assurance  coordinating  committee  who  would 
in  turn  direct  actions  by  the  departments  that  need  to  institute  the  actions 
necessary  to  affect  change. 

11.  Establish  follow-up  studies.  The  process  of  quality  assurance  is  not  complete 
until  the  problem  is  corrected.  To  Insure  compliance,  follow-up  studies  are 
required.  The  frequency  of  the  follow-ups  is  dependent  on  the  nature  of  the 
problem.  If  actions  to  correct  the  problem  can  be  taken  quickly  then  the  follow-up 
study  may  be  scheduled  shortly  after  the  initial  study.  Whatever  the  situation,  the 
follow-up  study  has  to  be  done  to  validate  the  efficiency  of  the  remedial  actions. 
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ANNEX  A 


I-  Organization 


- - - - 

EXECUTIVE  COMMITTEE 


II-  COMPOSITION  OF  QA  COC^RDINATINC.  COMMITTEE 


Chief,  Professional  Service  (CPS)  Chairman 

',<.inager  Movriber 

Nuping  QA  Coordinator  Member 

Chief,  Inpatient  Care  Branch  Member 

Administrative  Resident  Member 

Secretary  to  the  CPS  Recorder 


I 

FIGURE  4 


Some  problems  may  require  constant  monitoring;  the  emergency  room  has  a 
constant  flow  of  providers  and  therefore  to  assume  that  a  problem  is  resolved 
based  on  one  satisfactory  follow-up  audit  may  not  be  valid  in  the  long  run. 

12.  Submit  the  study  to  the  quality  assurance  coordinating  committee.  The 
complete  audit  should  be  forwarded  to  the  hospital  quality  assurance  coordinating 
committee  to  insure  that  the  flow  of  information  is  maintained.  The  committee 
needs  to  be  aware  of  ail  studies  for  a  number  of  reasons;  the  committee  must  keep 
the  hospital  executive  committee  informed,  it  must  recommend  prioritization  of 
quality  assurance  problems,  it  must  maintain  a  central  file  of  quality  assurance 
activities,  it  must  be  involved  in  order  to  insure  that  other  departments  institute 
changes  needed  to  remedy  the  problems,  and  to  preclude  duplication  of  effort,  the 
committee  must  be  aware  of  aii  studies.  The  intergrated/coordinated  aspects  of  an 
Institutional  plan  is  dependent  upon  the  input  from  all  the  quality  assurance 
activities  of  the  hospital. 

The  methodology  described  above  is  applicable  to  radiology,  pathology  and 
pharmacy  in  identification  of  problems  to  the  hospital  quality  assurance 
coordinating  committee.  This  methodology  is  not  all  encompassing,  problems 
associated  with  waiting  times,  internal  audits,  and  other  problems  may  be  better 
dealt  with  using  sources  other  than  the  patient  chart.  By  addressing  each  of  the 
twelve  steps  the  results  of  any  study  should  fulfill  the  criteria  of  the  Joint 
Commission's  quality  assurance  standard. 

Concurrent  Versus  Retrospect  Audit  Procedures 

As  noted  previously  the  pharmacy,  radiology,  and  pathology  services  must  rely 
on  retrospect  audits  of  patient  records  to  assess  care.  But  they  have  an  advantage 
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over  other  services;  in  doing  retrospective  audits  they  know  which  patients  they 
need  to  audit.  Even  with  a  low  records  retrieval  rate  the  services  are  able  to 
gather  enough  records  to  conduct  the  audit.  The  outpatient  clinics  do  not  have  a 
way  of  identifying  records  for  retrieval  as  records  of  which  patients  were  treated 
for  a  particular  disease  or  presented  in  a  clinic  with  a  particular  medical  complaint 
are  not  maintained.  In  order  to  conduct  audits  for  a  specific  diagnosis)  medical 
complaint)  or  medical/surgical  procedure  the  record  of  that  patient  must  be 
intercepted  at  the  clinic.  Since  retrieval  is  impossible,  concurrent  audit 
procedures  need  to  be  established  to  capture  the  data. 

Discussion  with  clinic  chiefs  confirmed  the  need  for  concurrent  audit 
techniques.  The  most  practical  method  for  identifying  the  chart  is  for  the  provider 
to  set  aside  any  record  which  is  to  be  audited.  The  charts  are  then  collected  and 
audited  at  the  end  of  the  day.  The  chart  should  not  be  retained  in  the  clinic  for  an 
extensive  period,  3  days  is  hospital  policy,  since  this  may  inconvenience  the  patient 
if  another  appointment  is  scheduled  or  if  laboratory/x-ray  reports  need  to  be  filed. 
The  individual(s)  who  are  to  conduct  the  audit  must  be  available  at  the  end  of  each 
day  to  perform  the  actual  auditing  of  charts.  The  individual  conducting  the  audit 
knows  exactly  how  many  charts  have  been  reviewed  and  therefore  sample  size  can 
be  controlled.  If  the  sample  is  to  be  50  charts  the  audit  can  be  cut  off  at  that 
point.  The  concurrent  audit  technique  should  work  well  in  the  outpatient  clinics. 

Criteria  Development 

The  development  of  criteria  is  fundamental  to  the  quality  assurance  process. 
An  objective  of  this  study  is  to  enable  paraprofessional  personnel  to  perform  the 
bulk  of  the  audit  process.  In  order  for  this  goal  to  be  achieved  the  development  of 
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explicit  audit  criteria  has  to  be  accomplished.  Discussions  with  various  ciinic 
chiefs  did  not  produce  a  concensus  of  agreement  in  this  area.  The  clinics  located 
in  the  hospital  who  have  fulltime  hospitai  staff  assigned  agreed  that 
paraprofessional  personnel  could  perform  the  chart  audits  with  certain  reasonabie 
limitations.  Howeveri  a  problem  does  exist  in  the  troop  health  clinics.  LTC  Puskas 
stated  that  his  staff  is  provided  on  a  rotationai  basis  by  the  15th  Combat  Support 
Hospital. 20  This  constant  personnel  turnover  limits  the  clinical  skills  of  the 
personnel  staffing  the  troop  health  clinics  and  therefore  he  felt  uncomfortable  with 
their  ability  to  conduct  adequate  audits.  The  result  is  that  in  the  troop  clinics  the 
professional  staff  would  have  to  conduct  the  chart  audit  portion  of  the  audit 
process. 

Even  in  those  clinics  who  have  the  paraprofessional  staff  available  to  conduct 
chart  audits,  the  professionals  directing  the  study  should  insure  that  the 
paraprofessionals  know  what  they  are  auditing.  The  completeness  of  subjective 
treatment  of  patients  is  difficult  to  define  in  a  set  of  explicit  criteria.  For  those 
situations  in  which  the  criteria  do  not  provide  definitive  guidance  the 
paraprofessional  should  have  a  point  of  contact  for  resolution  of  the  problem.  The 
physicians  who  establish  the  criteria  need  to  recognize  the  possibility  of 
"exceptions"  and  have  those  charts  which  do  not  fit  the  niold  referred  to  a 
professional  for  resolution. 
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CHAPTER  V 


DISPLAY  OF  DATA 
Statistical  Techniques 

The  data  to  be  utilized  in  conducting  outpatient  quality  assurance  studies 
represents  a  broad  spectrum  of  quantifiable  measures.  Waiting  times  are  expressed 
in  minutes  and  are  best  analyzed  by  employing  queuing  techniques.  Drug 
utilization  studies  involve  both  efficacy  of  treatment  and  cost  per  treatment. 
These  two  problems  require  different  types  of  statistical  analysis.  The  efficacy 
problem  is  outcome  oriented  and  in  order  to  demonstrate  the  effectiveness  of  one 
treatnient  over  another  a  hypothesis  testing  problem  is  necessary.  The  cost- 
benefit  situation  is  best  answered  in  terms  of  a  financial  management  economic- 
analysis  context.  Multi-criteria  audits  can  be  used  to  discover  composite 
compliance  rates,  or  to  target  specific  shortcomings  by  either  criteria  or  providers. 
These  different  expectations  require  different  statistical  tests  such  as  hypothesis 
testing,  analysis  of  variance  and  chi-squared  techniques.  The  purpose  of  this 
chapter  is  to  address  the  most  common  quality  assurance  problems  the  outpatient 
providers  will  encounter  and  provide  a  framework  for  assessing  study  results  in 
quantifiable  terms.  The  discussion  is  not  an  attempt  to  replace  a  statistics  text 
book  and  is  presented  only  as  a  basic  quide. 

Hypothesis  Testing 

Hypothesis  testing  is  applicable  to  studies  which  have  a  predetermined 
compliance  level  which  will  be  used  to  judge  performance  based  on  clinically  sound 
criteria.  For  example,  the  pathologists  are  concerned  whether  "stat"  tests  are 
actually  being  evaluated  by  the  staff  appropriately.  The  sole  criteria  for 
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evaluating  the  situation  might  be  "annotation  in  medical  records  of  test  results 
within  24  hours  of  completion  of  test."  In  order  to  test  this  criteria,  a  number  of 
decisions  need  to  be  made: 

1.  Determine  an  acceptable  compliance  rate.  In  many  areas  a  goal  of  100%  is 
mandated.  In  this  example  90%  will  be  used. 

2.  Establish  a  level  of  confidence.  This  is  the  probability  of  being  correct.  In 
this  example  the  pathologist  desired  a  95%  probability  of  being  correct. 

3.  Develop  the  hypothesis  and  define  the  terms.  The  expression  of  the  hypothesis 
in  statistical  notation  is  not  necessary  but  is  helpful  for  convenience.  To  be  able  to 
use  notation,  a  legion  of  symbols  to  be  used  is  included. 

P  =  The  population  portion 

n  =  The  sample  size 

X  =  The  number  of  samples  which  fulfill  the  criteria 

p  =  The  sample  proportion,  the  estimate  of  P 

<fp  =  The  standard  error  of  the  sampling  distribution  of  the  sample 
proportion 

Hq  =  The  null  hypothesis 

=  The  alternate  hypothesis 

Pq  =  A  number  representing  a  hypothesized  value  of  the  population 
tc  »  Level  of  significance,  1  -  (level  of  confidence) 

E  =  Maximum  tolerable  difference  or  error  between  the  population 
portion  and  the  sample  estimate 
Z^=  The  standardized  normal  variate  use  in  a  one-tail 
CV  =  The  critical  value 
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/=  The  standardized  normal  variate  use  in  a  two-tail  test. 

2 

Not  all  the  values  for  the  symbol  shown  above  have  been  computed  as  of  yet.  At 
this  point  the  hypothesis  can  be  developed. 

Ho:P2;.90-“  population  proportion  complying  with  the  criteria  is  equal  to 
or  greater  than  90%) 

alternative  hypothesis  is  that  the  compliance  rate  is  less  than 

90%) 

a=.  05 —  (95%  probability  of  being  correct) 

.65--  Standard  normal  value  ofC^=  .05  in  a  one  tail  test  of  significance 
(Z  value) 

4.  Determine  the  sample  size.  Several  decisions  need  to  be  made  in  estimating 
the  sample  size. 

a.  Determine  the  maximum  percentage  of  error  in  estimating  the  portion  of 
the  population  which  is  fulfilling  the  criteria.  The  pathologist  wants  the  estimate 
of  the  population  portion  not  to  differ  from  the  actual  population  portion  by  more 
than  .05  (5%). 

b.  Compute  the  sample  size.  One  last  decision  has  to  be  made  prior  to 
computing  an  estimate  of  what  the  portion  of  compliance  is.  Despite  the 
incongruency  since  the  purpose  of  the  audit  is  to  determine  the  portion,  some  value 
must  be  assigned.  An  estimate  of  50%  will  result  in  the  largest  sample  size 
estimate,  deviation  either  side  of  50%  will  decrease  the  sample  size  estimate.  A 
small  pilot  audit  might  suggest  a  figure  of  70%  or  the  pathologist  may  just  have  an 
intuitive  estimate.  If  in  retrospect  the  sample  size  was  too  small  the  preciseness 
of  the  estimate  will  suffer.  Similarly,  if  the  sample  size  is  actually  greater  than 
necessary  the  precision  of  the  estimate  will  increase.  In  this  example  a  pilot  study 
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suggests  that  a  compliance  rate  is  approximately  80%.  The  following  information 
is  now  available. 

E  -  .05  Maximum  difference  or  error  between  the  population  portion  of 
compliance  and  the  sample  estimate. 

P  =  .80  Estimate  of  actual  compliance  based  on  pathologist's  estimate 

0^  =.Q5  Level  of  significance 
1.65  2  value 

To  compute  the  sample  size  estimate  the  following  formula  is  used; 

n=P-(l-P)  =  .80(.20)(1.65/.05)2 

.80(.20)(33)2  =  .80(217.8)=  174.2  or 

175,  always  round  up 

5.  Conduct  the  audit  and  record  results.  The  number  of  charts  which  fulfill  the 
audit  criteria  x  is  divided  by  the  number  of  records  audited,  n  or  sample  size,  to 
arrive  at  p,  the  sample  proportion  or  estimate  of  P.  Continuing  this  example  180 
records  were  audited,  n  -  180,  and  150  met  the  criteria,  x  =  150.  The  calculation  of 
the  sample  portion  is: 

p=x/n=150/180=,833 

6.  Test  the  hypothesis.  The  test  of  the  hypothesis  involves  the  following 
information: 

n=180,  =.05,  x=150,  Po=.90,  Z^=1.65, 

CV=unkown,  p=unkown. 

Ho:  P^.90 

P^.90 
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The  criteria  value  represents  the  decision  point  in  the  hypothesis  test.  The 
critical  value  is  a  combination  of  the  hypothesis  value  of  the  population  with  an 
adjustment  which  is  the  standard  error  of  the  sampling  distribution.  The  result  is  a 
value  below  which  the  null  hypothesis  can  be  rejected.  The  calculating  formula  for 
CTp  is: 


CJp=  /  Po(l-Po) 


.90n-.90) 
180 


V 


TW 


180 


^.0005  = 


(.0223607) 


The  critical  value  (CV)  -  Pq  -2q^= 


. 90-1. 65(. 0223607)= 
.90-. 037  = 

.863 


Decision  rule: 


ACCEPT  Ho:pi.863 
REJECT  Ho:p*:.863 

The  value  of  p  =  .83  (i.e.,  p  =  |50  )  therefore  the  null  hypothesis  is  rejected 

and  the  alternate  hypothesis  is  accepted.  Referring  back  to  the  development  of 
the  criteria  for  the  study  it  can  be  concluded  that  "stat"  test  results  are  not 
annotated  in  the  medical  record  within  hours.  Before  concluding  the 
pathologists  may  want  to  check  the  possible  error  in  estimating  the  population 
portion  based  on  the  sample  size  and  portions.  This  relates  back  to  the  sample  size 
estimate  formula, 

n=P(l-P)  (Zc^/E)2 

That  formula  can  be  manipulated  to  solve  for  E, 


P(1-P) 

n 
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Based  on  the  survey  results  the  value  of  E  is: 

E=1.65  /.83(1-.83)  = 

V  180 

1.65(. 027998)=  .046 

The  final  value  of  E  (.046)  is  less  than  the  value  stipulated  earlier  in  the  problem 
(.05)  therefore  the  sample  size  estimate  was  adequate. 

The  pathologist  is  at  step  9  of  the  protocol  outlined  in  the  previous  chapter  for 
conducting  an  audit.  The  study  will  be  complete  by  fulfilling  the  next  four  steps 
outlined. 

Hypothesis  testing  is  not  applicable  to  ail  types  of  quality  assurance  studies 
but  when  applicable  it  does  provide  a  relatively  simple  valid  statistical  testing 
methodology.  The  level  of  sophistication  of  the  testing  requirements  should  be 
within  the  grasp  of  any  health  professional  in  the  hospital.  The  specifics  of  the 
process  may  have  to  be  refreshed  and  any  medical  library  contains  ample  reference 
material. 

In  the  previous  example  several  points  were  glossed  over.  They  included  one 
tail  versus  two  tail  test,  the  use  of  a  Z  table,  and  the  requirement  for  iarge  versus 
srnali  sample  size  considerations.  Rather  than  expand  on  the  technical  aspects  of 
these  issues  the  reader  is  referred  to  the  statistical  textbooks  in  the  bibliography. 
Those  authors  present  a  very  readable  explanation  of  hypothesis  testing 
considerations. 

Descriptive  Statistics 

The  occasion  may  arise  that  a  study  concerned  with  "discovery"  is  to  be 
instituted.  Discovery  is  useful  in  describing  a  situation  for  which  a  performance 
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objective  is  not  established.  For  example,  the  Chief,  Professional  Services  may  be 
interested  in  the  number  of  times  a  patient  receives  a  busy  signal  when  attempting 
to  call  for  a  medical  appointment.  The  obvious  method  to  obtain  an  approximation 
of  this  problem  is  to  conduct  a  data  gathering  experiment  which  will  consist  of  n 
eiements  which  will  together  comprise  the  sample.  The  elements  discussed  earlier 
regarding  factors  which  should  be  considered  in  sampling  apply  i.e.,  timeliness, 
cost,  precision,  randomness,  and  independence.  The  outcome  of  the  sample  should 
provide  a  minimum  of  the  following  elements: 

X  =  Value  of  the  measurement  in  the  sample  (unsuccessful  number  of  phone 
attempts 

n  =  The  sample  size 

T  =  The  sample  mean  (arithmetic  average) 

=  The  sample  variance 
s  =  The  standard  deviation  of  sample 
mode  =  The  most  common  value  in  the  sample 
R  =  Range  of  values 

median  =  The  middle  value  or  the  average  of  the  two  middle  values  if  an  even 
number  of  values  in  the  range 

In  addition  to  the  above  data  the  sample  results  should  contain  a  graphic 
representation  of  a  frequency  polygon  (Figure  5).  This  graphic  presentation  enables 
the  observer  to  judge  the  symmetry  and/or  skewness  of  the  sample.  This  visual 
presentation  alleviates  a  great  deal  of  narrative  description  as  the  picture  sneaks 
for  itself. 
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The  actual  calculation  of  the  statistics  of  a  sample  and  the  construction  of  the 
visual  presentation  of  the  data  can  be  performed  on  the  Hewlett-Packard 
minicomputer  located  in  the  hospital.  Use  of  the  hospital's  minicomputer  will  be 
discussed  later  in  this  chapter. 

Subsequent  to  data  collection,  computation  of  the  statistics,  and  visual 
presentation,  evaluation  of  the  sample  results  can  be  undertaken.  The  sample 
results  may  reveal  what  is  perceived  as  a  problem  or  the  results  may  be  favorably 
received  and  the  process  is  ended.  If  the  results  indicate  a  problem  then  the  data 
becomes  the  baseline  data  for  evaluating  the  effectiveness  of  follow-up  actions. 
The  follow-up  hypothesis  can  either  be  based  on  the  initial  results  or  another 
objective.  For  example  if  an  average  (x)  of  3  unsuccessful  attempts  to  reach  the 
appointment  clerk  proceeded  the  actual  telephone  discussion  that  statistic  (50  or  a 
lower  one,  2  attempts  could  be  the  hypothesized  value. 

unsuccessful  attempts  2  unsuccessful  attempts 

or 

3  unsuccessful  attempt^  unsuccessful  attempts 

The  sample  is  extremely  useful  in  developing  a  basis  for  decision  making  and 
subsequent  evaiuation  of  foliow-up  action  effectiveness. 


Analysis  of  Variance 

The  analysis  of  variance  test  is  useful  in  evaluating  the  effectiveness  of 
quality  assurance  follow-up  actions.  The  analysis  of  variance  test  enables  the 


individual  conducting  a  study  to  evaluate  the  effectiveness  by  comparing  the 
compliance  rates  for  the  various  criteria  in  two  random  samples  by  comparing  the 
sample  variances.  An  explanation  of  the  reasons  why  an  evaiuation  of  sample 


variance  can  be  used  to  determine  whether  the  compliance  rates  are  equal  or 
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statistically  different  is  again  best  left  to  the  statistics  textbooks. 

An  example  of  the  analysis  of  variance  test  will  be  demonstrated  via  the  audit 
data  included  in  the  corneal  abrasion  audits  (Appendix  O  and  E).  The  criteria  for 
the  audit  was  developed  (Appendix  D),  and  an  initial  audit  of  32  records  revealed 
the  following  non-compliance  rates: 

Criteria: 


Initial 

Follow-up 

a. 

No  mechanism  of  injury  noted 

12.5% 

10.5% 

b. 

No  subjective  systems  listed 

40.6% 

36.8% 

c. 

No  visual  activity  noted 

21.8% 

36.8% 

d. 

No  fluorescein  test  cited 

46.8% 

36.8% 

e. 

No  eye  inspection  noted 

0% 

0% 

f. 

Diagnosis  not  given  as  "corneal 
abrasion" 

9.3% 

10.5% 

g* 

Treatment  plan  did  not  list 
topical  antibiotic 

65.6% 

21.0% 

h. 

Treatment  plan  did  not  list 
pressure  patch 

50.0% 

36.8% 

i. 

Follow-up  did  not  specify 
return  visit  within  24  -  48 
hours 

34.3% 

0% 

The  results  of  the  study  prompted  actions  to  educate  the  emergency  room 
staff  on  the  criteria  which  would  be  the  yardstick  for  further  evaluation.  The 
effectiveness  of  the  follow-up  actions  was  measured  by  an  audit  of  19  charts  using 
the  same  criteria  and  the  results  are  listed  in  the  follow-up  heading  above.  Taking 
into  account  the  negative  approach  of  the  audit  and  the  measurement  of  non- 
compliance  rather  than  compliance,  the  follow-up  figures  reflect  a  general  overall 
improvement  in  care.  The  question  is  whether  it  is  statisticaily  significant.  The 
analysis  of  variance  test  provides  the  framework  for  determining  whether  the 
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improvement  is  based  on  an  actual  increase  in  the  performance  of  the  emergency 
room  staff  or  if  the  improvement  can  be  attributed  to  chance. 

To  illustrate  the  analysis  of  variance  test,  the  data  for  the  corneal  abrasion 
test  was  fed  into  the  hospital's  minicomputer.  The  calculations  involved  in 
performing  this  test  are  tedious  and  best  left  to  a  computer.  The  test  can  be  done 
manually,  but  the  time  involved  in  manually  calculating  the  results  would  be  too 
great  to  reasonably  expect  a  statistics  novice  to  invest.  The  printout  (Figure  6) 
provides  a  number  of  key  values  for  the  individual  who  conducts  the  study  to 
review.  The  top  array  of  data  listed  as  treatment  #1  and  //2  is  merely  the  non- 
compliance  rates  for  the  initial  (treatment)  and  the  follow-up  (treatment  2)  audits. 
Next,  the  computer  calculated  the  mean  (average)  non-compliance  rates  for 
treatment  1  and  2.  The  variance,  i.e.,  471.1536  and  262.6319  respectively  is  the 
sum  of  all  the  (observed  values  -  mean)2  The  Initial  study  had  a  non-compliance 
rate  of  31.2111%  and  the  follow-up  audits  non-compliance  rate  was  21.22%.  The 
decrease  in  noncompliance  (10%)  is  sizeable  but  the  key  to  determining  if  this 
reduction  was  statistically  significant  is  the  F  statistic.  In  this  example  the  F 
statistic  is  1.2733.  If  the  auditor  wants  to  be  95%  confident  that  the  difference  in 
the  mean  values  of  the  sample  results  is  not  due  to  chance,  a  critical  value  of  the  F 
statistic,  in  this  case  of  1  degree  of  freedom  in  the  numerator  (DF  NUM)  and  16 
degrees  of  freedom  in  the  denominator  (DF  DEN),  the  critical  value,  4.49,  can  be 
extracted  from  any  statistics  textbook.  The  calculated  F  statistic  1.2733  is  less 
than  F  critical,  4.49,  therefore  the  auditor  is  not  able  to  state  that  the  differences 
in  the  non-compliance  rates  are  different  and  be  95%  confident  of  being  correct. 
The  printout  shows  the  level  of  significance  associated  with  an  F  statistic  of 
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1.2733.  By  subtracting  the  level  of  significance  from  1,  the  level  of  confidence  is 
revealed  (1  -.2758  =  .7242).  In  any  statement  regarding  the  difference  between  the 
non-compliance  rates  the  auditor  could  only  be  72.4%  certain  the  difference  was  do 
to  actual  changes  in  the  staff's  compliance  with  the  audit  criteria. 

The  analysis  of  variation  test  appears  to  be  extremely  complicated  at  first 
glance  but  with  the  aid  of  the  computer  the  ciinlcan  has  a  powerful  analytic  tool  at 
his  disposal.  The  F  statistic  is  the  key  to  evaluating  the  test  results  and  the 
Hewitt-Packard  minicomputer  automatically  calculates  not  only  the  F  statistic  but 
also  the  level  of  significance  for  the  test.  By  subtracting  the  level  of  significance 
from  1,  the  clinican  has  the  level  of  confidence  which  the  results  represent.  The 
determination  of  what  level  of  significance  is  necessary  to  demonstrate  a  real 
change  depends  on  the  level  of  risk  the  individual  conducting  the  study  is  willing  to 
take  in  accepting  the  results. 

Additional  Statistical  Techniques 

Hypothesis  testing,  descriptive  statistics,  and  analysis  of  variance  can  be  used 
in  a  great  number  of  quality  assurance  studies.  But  these  three  statistical 
procedures  will  not  cover  all  possible  situations  which  may  be  encountered.  The 
individual  conducting  the  quality  assurance  study  needs  to  be  aware  that  there  is  a 
wide  assortment  of  statistical  tests  which  can  assist  in  determining  the 
significance  of  the  problem  or  the  effectiveness  of  the  corrective  action.  Many  of 
the  tests  are  included  in  the  library  of  programs  available  on  the  Hewlett-Packard 
minicomputer.  The  library  contains  three  packages  of  programs  which  can  be  used 
extensively  in  the  quality  assurance  program. 
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critical  value  of  F  is  4.26.  The  auditor  can  evaluate  the  computed  F  statistic  for 
the  rows  and  columns.  Both  of  the  computed  F  statistics  exceed  the  critical  value 
of  F  .05  (2,9).  Therefore  a  statistically  significant  conclusion  can  be  drawn 
concerning  the  equality  of  the  mean  for  the  three  rows  and  columns.  The  critical 
value  for  the  interaction  between  the  rows  and  columns  (R  x  C)  is  F.05  (df  =  4,  9)  = 
3.63.  The  computed  F  statistic  (.8)  indicates  that  the  interaction  between  the 
column  observation  and  the  row  observations  does  not  produce  an  effect  which  is 
statistically  significant. 

Analysis  of  Variance 


SOURCE 

DF 

SS 

MS 

F 

Total 

17 

44.5 

Rows 

2 

22.3 

11.2 

10.6 

Cols 

2 

9.3 

4.7 

4.4 

RXC 

4 

3.3 

0.8 

0.8 

Error 

9 

9.5 

1.1 

Fcritical  (Rows)  = 

F.05  (df  = 

2,  9)  =  4.26 

^'critical  (Columns)  =  F.05  (df  =  2,  9)  =  4.26 
Fcritical  (Row  X  Columns)  =  F.05  (df  =  4,  9)  =  3,63 

Figure  7 

The  other  method  to  determine  the  probability  associated  with  the  computed  F 
value  is  to  utilize  the  next  program  in  the  General  Statistics  Package.  This 
program  deals  with  various  types  of  distributions  and  allows  the  user  to  determine 
exact  probabilities  associated  with  any  one  of  the  following  distributions: 

a.  Normal, 

b.  Student, 
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The  three  packages  which  contain  the  programs  are; 

1.  The  General  Statistics  Package, 

2.  The  Regression  Analysis  Package,  and 

3.  The  Graphic  Presentation  Package. 

The  General  Statistics  Package  has  the  following  programs  which  are 
applicable  to  the  quality  assurance  program: 

1.  One  sample  analysis  -  this  program  will  provide  a  basic  statistical  description 
of  a  set  of  data.  An  example  of  the  output  is  at  Appendix  K. 

2.  Paired  sample  analysis  -  this  program  will  conduct  a  variety  of  statistical 
tests,  to  include  descriptive  statistics,  paired  F  statistics,  regression  analysis  for 
parametric  values,  (i.e.,  values  from  a  normal  universe).  There  are  also  tests 
available  to  test  nonparametric  data.  These  tests  includes  The  Spearman's  Rho, 
Kendall's  Tau,  sign  test  and  Wilcoxon  signed  rank  test.  An  example  of  the  output  is 
at  Appendix  L. 

3.  Test  statistics  -  five  separate  routines  are  available  to  perform  specific 
statistical  tests.  They  are; 

a.  Chi-square  test, 

b.  R  x  C  contingency  test, 

c.  Two  sample  T-test, 

d.  One-way  analysis  of  variance,  and 

e.  Two-way  analysis  of  variance. 

The  Chi-square  test  calculates  the  probability  that  observed  outcomes  of 
various  events  are  significantly  different  than  the  expected  outcomes.  This  routine 
will  calculate  a  chi-squared  value  and  probability  for  either  unequal  or  equal 
expected  values.  An  example  of  the  output  is  at  Appendix  M. 
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The  R  X  C  contingency  test  computes  a  chi-squared  value  for  measuring  the 
independence  of  variables.  An  example  of  the  output  is  at  Appendix  N. 

The  two  sample  T-test  computes  the  basic  statistics  for  two  small  samples 
(size  less  than  30)  and  also  computes  a  t-value  and  the  approximate  probability.  An 
example  is  at  Appendix  O. 

The  one-way  analysis  of  variance  test  was  used  to  produce  Figure  6,  in  the 
previous  discussion.  The  routine  is  extremely  useful  to  perform  this  rigorous 
statistical  test.  An  example  of  output  is  at  Appendix  P. 

The  two-way  analysis  of  variance  test  provided  information  to  enable  the 
auditor  to  analyze  the  variations  in  test  values  by  both  row  and  column  as  well  as 
the  interactive  effect.  The  output  is  shown  at  Appendix  Q.  This  particular  test 
does  not  compute  the  probabilities  associated  with  the  values  shown  in  the  analysis 
of  variance  table. 

The  individual  conducting  the  study  has  two  choices  for  assessing  the 
significance  of  the  F  values.  The  critical  value  of  the  F  statistic  can  be  extracted 
from  an  F-distribution  chart  (an  appendix  to  most  statistics  book)  by  identifying 
three  values;  the  level  of  significance,  normaliy  either  .05  or  .01,  the  degrees  of 
freedom  in  the  numerator,  and  the  degrees  of  freedom  in  the  denominator.  Using 
the  example  below  (Figure  7)  the  degrees  of  freedom  in  the  numerator  is  the  value 
listed  under  "DF"  and  is  next  to  each  of  the  sources,  i.e.,  rows,  columns  and  row 
and  column.  The  degrees  of  freedom  in  the  demonimator  is  shown  as  the  degrees 
of  freedom  "DF"  of  the  error.  By  stipulating  a  level  of  significance  of  .05  with  2 
degrees  of  freedom  in  the  numerator  and  9  degrees  of  freedom  in  the  denominator 
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c.  Central  F, 

d.  Chi-squared, 

e.  Binomial, 

f.  Poisson, 

g.  Weibull,  and 

h.  Hypergeometric. 

In  the  case  of  the  F  statistic  the  auditor  merely  has  to  call  up  the  program, 
specify  the  distribution  desired,  and  enter  three  values; 

1.  The  degrees  of  freedom  in  the  numerators, 

2.  The  degrees  of  freedom  in  the  denominator,  and 

3.  The  value  of  F. 

The  computer  will  calculate  the  level  of  significance  associated  with  the  data 
entered  to  an  accuracy  of  seven  digits.  This  program  eliminates  the  need  for  the 
user  to  refer  to  a  table  and  manually  determine  the  probability. 

The  last  program  in  the  General  Statistics  Package  is  Multiple  Linear 
Regression.  This  program  enables  the  operator  to  determine  if  a  correlation  exists 
between  a  dependent  variable  and  up  to  12  independent  variables.  The  program 
will  analyze  the  data  and  compute  the  following; 

1.  Mean  and  variance  for  all  variables, 

2.  Correlation  matrix, 

3.  Analysis  of  variance  table, 

4.  Estimates  of  variances, 

5.  F-value  for  regression  coefficients,  and 

6.  Multiple  correlation  coefficients. 
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An  example  of  the  program  output  is  at  Appendix  R.  The  multiple  linear 
regression  program  performs  a  complex  analysis  very  quickly.  The  individual 
evaluating  the  results  needs  an  understanding  of  the  different  types  of  information 
provided  and  how  to  use  the  result  in  formulating  conclusions.  The  operators  need 
to  consult  the  literature  or  discuss  the  problem  with  a  knowledgeable  individual 
before  attempting  to  use  this  program. 

Another  package  of  programs  designed  for  the  Hewlett-Packard  minicomputer, 
the  Regression  Analysis  Package,  consists  of  programs  which  represent  an 
extensive  array  of  routines  to  evaluate  regression  analysis  problems.  The  programs 
include  simple  linear  regression,  multiple  regression  and  a  sophisticated  assortment 
of  techniques  to  manipulate  and  evaluate  regression  results.  This  package  of 
programs  would  be  useful  to  those  individuals  who  are  conducting  indepth  research. 
The  applicability  of  this  particular  collection  of  programs  would  be  limited  in  the 
normal  course  of  quality  assurance  studies.  Individuals  who  might  desire  to  publish 
results  on  a  particular  problem  and  need  more  powerful  analytic  tools  than  is 
provided  by  the  regression  analysis  program  in  the  Generai  Statistics  Package  may 
be  interested  in  this  collection  of  programs. 

The  Graphic  Presentation  Package,  the  third  computer  package  in  the  library, 
is  an  optionai  feature  of  the  minicomputer  which  enables  the  operator  to  produce 
professional  looking  charts,  graphs,  and  drawings.  The  program  allows  an  output 
(i.^.,  bar  graphs,  line  graphs,  and  pie  charts)  to  be  vjesigned  on  a  video  screen  and 
then  transferred  to  a  presentation  media,  either  paper  or  view-graph  (Figures  8,  9, 
10).  The  results  are  impressive  but  the  time  necessary  to  learn  how  to  operate  the 
program  is  prohibitive.  Like  the  Regression  Analysis  Package,  the  applicability  of 
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this  program  to  normal  quality  assurance  studies  is  limited.  Any  individual  who 
desires  to  produce  a  professional  quality  chart  or  graph  utilizing  the  minicomputer 
has  to  be  willing  to  devote  several  hours  to  that  task.  As  with  the  previously 
discussed  programs,  this  tool  should  be  limited  to  articles  for  publication  and 
formal  presentations. 

Data  Collection  Worksheets 

The  problem  of  collecting  the  proper  data  can  be  eased  by  developing  data 
collection  forms  which  facilitate  the  recording  of  pertinent  information. 

The  thrust  of  the  outpatient  clinical  quality  assurance  programs  will  be  the 
evaluation  of  patient  care  based  on  valid  criteria.  In  the  audit  setting  certain 
information  must  be  recorded  for  analysis.  That  information  includes: 

1.  Provider  identification. 

2.  Criteria  identification. 

3.  Patient  identification.  In  concurrent  audits  the  ability  to  identify  the 
patient  whose  record  is  being  audited  is  critical.  Significant  shortcomings  in  the 
completeness  of  the  care  provided  may  result  in  follow-up  action  being  initiated  to 
correct  deficiencies.  One  of  the  primary  advantages  of  concurrent  audits  is  the 
potential  to  quickly  identify  deficient  patient  care  and  to  take  corrective  actions 
to  ameliorate  the  situation.  Therefore  the  identity  of  each  audited  record  is 
important. 

4.  Criteria  evaluation  findings.  The  audit  results  should  be  recorded  in  such 
a  way  that  a  reviewing  official  can  identify  the  source  of  problems.  This  involves 
the  results  of  the  providers  performance  in  each  criteria,  the  providers  aggregate 
performance,  and  the  review  of  compliance  based  on  both  individuai  criteria  and 
composite  criteria. 
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Use  identi faction  code,  do  not  us  name 

Patient  identifaction  consist  of :beneficiary  code, last  four  digits  of  SSAN,  last  name. 

Example;  30 ,1234, Jones . 


PROVIDER  CODE 


should  be  entered  in  the  appropriate  block  in  the  bottom  right  portion  of  the 
worksheet.  At  this  point  the  auditor  can  review  the  performance  of  the  individual 
provider  by  either  criteria  or  individual  patient  results.  The  statistical  tests 
discussed  earlier  can  be  employed  to  test  the  significance  of  the  results. 

In  those  instances  in  which  more  than  one  provider  have  been  audited  the 
worksheet  shown  on  the  following  page  (Figure  12,  Summary  Audit  Matrix)  enables 
the  totals  of  the  individual  provider's  worksheets  to  be  recorded.  To  complete  this 
worksheet  the  auditor  merely  transfers  the  information  on  the  individual  worksheet 
to  the  summary  matrix.  The  criteria  column  is  merely  a  reiteration  of  the  pre- 
established  criteria.  The  provider  identification  block  should  be  completed  with 
the  same  provider  code  as  used  on  the  individual  worksheets.  The  actual  and 
possible  figures  for  each  criteria  are  transcribed  to  the  summary  matrix.  The 
compliance  percentage  could  be  entered  instead  of  the  actual/possible  figures  if 
each  of  the  providers  had  an  equal  number  of  records  audited.  The  probability  of 
having  equal  possible  values  for  each  provider  is  minimal.  Therefore  to  avoid 
distorting  the  cumulative  percentage,  the  actual  and  possible  values  are  totaled 
and  the  percentage  value  is  determined  from  the  resultant  totals. 

The  blocks  in  the  bottom  right  hand  portion  of  the  matrix  are  provided  to 
record  the  overall  values  of  the  audit  results.  The  "actual"  and  "possible"  values  in 
that  block  should  be  the  same  if  the  horizontal  or  vertical  marginal  values  are 
added.  A  check  of  the  correctness  of  the  matrix  can  be  done  by  adding  the 
horizontal  and  vertical  marginal  values  to  insure  the  totals  are  the  same.  The 
calculation  of  the  overall  compliance  rate  should  be  computed  based  on  the 
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SUMMARY  AUDIT  MATRIX 
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cumulative  marginal  values  of  the  actual  and  possible  outcomes.  The  reason  for 
computing  the  overall  compliance  rate  on  the  total  vaiue  of  the  actuai/possible 
values  is  the  same  as  was  mentioned  previously  in  determining  the  marginal 
percentages,  i.e.,  different  values  of  the  denominator. 

The  summary  audit  matrix  provides  the  auditors  a  concise  array  of  data  by 
which  a  number  of  statistical  tests  can  be  performed.  One  and  two  way  analysis  of 
variance,  hypothesis  testing,  and  chi-squared  test  can  be  performed  from  the 
information  provided.  In  addition  to  statistical  testing,  the  data  provided  can  also 
be  used  to  calculate  descriptive  statistics.  The  matrices  are  not  a  panacea  for  all 
data  collection  situations  but  they  are  versatile  and  should  provide  assistance  in 
most  situations  in  which  data  is  to  be  collected  for  quality  assurance  studies. 

Summary 

The  capabilities  of  the  hospital  owned  Hewlett-Packard  minicomputer  have 
been  discussed  previously.  The  minicomputer  has  one  serious  limitation}  the 
quality  of  the  user-manuals.  The  manuals  are  not  for  a  novice  operator.  The 
instructions  are  short,  the  error  messages  are  confusing,  and  the  logic  behind  the 
programs  is  not  clear.  In  short  it  would  not  be  beneficial  for  a  first  time  user  to 
attempt  to  take  advantage  of  the  minicomputer's  abilities  without  the  assistance  of 
a  knowledgeable  individual.  With  the  assistance  of  a  competent  individual,  the 
novice  will  be  able  to  enter  the  needed  data  and  evaluate  the  results. 

The  technicial  aspects  of  the  computer  programs  require  that  the  user  not  only 
have  assistance  in  actual  keyboard  functions  necessary  to  manipulate  the  program 
but  also  the  user  needs  to  know  what  data  is  needed  by  the  program.  To  preclude 
the  frustration  of  not  being  able  to  complete  a  program  due  to  a  lack  of  required 
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information,  the  individual  performing  the  analysis  should  consult  the  users  manual 
and/or  a  knowledgeable  individual.  The  data  collection  efforts  should  be  focused 
on  those  items  which  are  necessary  to  conduct  the  appropriate  statistical  tests. 
Generally,  the  minicomputer  requires  the  same  information  which  would  be  needed 
for  manual  calculations;  the  primary  difference  is  format.  If  the  data  is  not  easily 
manipulated  into  the  format  the  computer  requires,  much  time  can  be  wasted  at 
the  keyboard. 

The  identification  of  an  individual  to  provide  guidance  and  assistance  for  the 
minicomputer  operations  presents  a  problem.  The  hospital  has  the  minicomputer 
but  a  position  is  not  authorized  for  a  computer  operator.  The  need  for  an  operator 
is  acute  and  much  is  to  be  gained  from  the  utilization  of  automated  statistical 
assistance.  Currently,  there  is  a  very  limited  number  of  individuals  who  have  used 
the  computer,  and  those  who  have  used  it  have  not  utilized  the  entire  array  of 
programs.  To  rectify  this  shortcoming  consideration  needs  to  be  given  to  training 
several  individuals  involved  in  the  quality  assurance  program  in  the  operation  of 
the  minicomputer.  The  identification  of  consultants  for  computer  assistance  in 
support  of  quality  assurance  studies  would  remove  a  significant  hurdle  in 
performing  the  analytic  portion  of  a  study. 
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Footnotes 

^R.C.  Gulezian.  Statistics  for  Decision  Makingt  (Ptiiladelphia,  1979),  p.  28i. 


CHAPTER  VI 


CONCLUSION 

Quality  assurance  in  the  ambulatory  care  setting  can  be  accomplished  within 
the  current  organizational  structure  of  Army  community  hospitals.  The 
implementation  of  a  program  needs  to  be  based  on  solid  principles.  The  thrust  of 
the  program  should  be  based  on  Imparting  optimal  health  care  within  the 
constraints  under  which  each  facility  operates.  To  determine  what  would 
constitute  optimal  health  care,  the  organization  should  assess  the  health  services  it 
provides.  The  survey  of  medical  complaints  and  diagnoses  is  one  basis  for  assessing 
frequency  or  volume  of  service.  Once  this  information  is  available  the  professional 
staff  can  initiate  actions  to  assess  the  quality  of  care. 

The  assessment  of  care  should  require  decisions  on: 

1.  What  should  be  assessed. 

a.  Structure 

b.  Process 

c.  Outcome 

2.  What  type  of  judgement  should  be  used. 

a.  Explicit 

b.  Implicit 

3.  What  type  of  data  retrieval  methodologies  should  be  employed. 

a.  Prospective 

b.  Retrospective 

c.  Concurrent 
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Subsequent  to  data  collection  the  analysis  of  data  is  critical.  Based  on  the 
outcome  of  the  data  analysis,  the  professional  staff  must  determine  what,  if  any, 
corrective  actions  should  be  taken.  At  this  juncture  the  activity  conducting  the 
study  needs  to  communicate  with  the  central  quality  assurance  activity.  The 
transmittal  of  information  enables  the  central  committee  to  assess  the  need  for 
the  allocation  of  additionai  resources,  to  disseminate  the  information  to  other 
similar  activities,  to  assign  priorities,  to  communicate  action  to  the  Executive 
Committee,  and  to  monitor  foliow-up. 

The  actions  taken  to  rectify  deficiencies  noted  in  the  first  assessment  must  be 
documented  and  only  when  follow-up  analysis  reveals  improvement  is  the  quality 
assurance  process  effective. 

The  use  of  statistics  in  demonstrating  improvement  in  the  quality  assurance 
process  is  viewed  as  an  aid  to  the  professionals  conducting  QA  studies.  With  the 
assistance  of  a  minicomputer  the  professional  has  a  wide  array  of  statistical 
techniques  available.  In  order  for  the  professional  to  capitalize  on  the  advantages 
of  computer  assisted  statistical  applications,  a  consultant  must  be  identified.  The 
consultants  need  to  be  famllar  with  quaiity  assurance  principles,  statistical  testing 
techniques,  and  the  computer  statistical  programs. 

The  quality  assurance  program  for  ambulatory  care  should  not  be  a  repeat  of 
the  inpatient  chart  audits  which  were  conducted  in  the  1970's.  Avoiding  the  pitfall 
of  assessing  care  but  not  taking  corrective  action  and  insuring  foliow-up  audits  to 
validate  the  appro'  riateness  of  the  corrective  actions  must  be  constantly 
addressed.  The  effectiveness  of  the  program  depends  on  the  leadership  exhibited 
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by  the  members  of  the  QA  Committee  and  the  Executive  Committee.  Without 
their  guidance  the  QA  efforts  of  the  institution  will  be  sporactic. 

The  importance  of  quality  assurance  commands  the  fullest  support  of  the 
hospital  leadership  and  the  potential  benefits  justify  the  expenditure  of  that  effort. 
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APPENDIX  A 


QUALITY  ASSURANCE  PLAN 


;DAC  Mer,;o  40-91 


Me~crandu.T! 
No.  40-9 i 


DEPARTMENT  OF  THE  ARMY 

Headquarters ,  US  Army  Medical  Department  Activity 
Fort  Belvoir,  Virginia  22060 


22  December  1980 


Medical  Services 
QUALITY  ASSURANCE  PLAN 


1.  Purpose..  The  purpose  of  this  memorandum  is  to  establish  a  written  plan  that 
will  serve  as  a  basis  for  a  comprehensive,  fully  integrated,  problem-focused 
■approach  to  a  Qua1  ity  Assurance  Plan  for  US  DeL'itt  Army  Hospital  (USDAH). 

2.  General.  The  i^.-arall  goal  of  the  Quality  Assurance  Program  (QAP)  is  to 
demonstrate  USDAH's  comprehensive  and  integrated  approach  to  quality  assurance. 
The  principal  objective  of  the  QAP  is  to  facilitate  the  ongoing  identification 
and  assessment  of  problems  associated  with  clinical  performance  and  the  delivery 
of  patient  care/cl inical  performance  with  the  intent  of  improving  such  care  to- 
an  optimal  level  within  available  resource  constraints.  The  _E_xocuti Comrrntteo 
^hall  serve  also  as  the  Quality  Assurance  Commi tj:ee  for^^ySb^H'. 

.3.  Scope.  Quality  Assurance  (QA)  refers  to  all  organizational  activities  that 
are  designed  to  foster  or  evaluate  patient  care.  It  includes  all  departments, 
d I'scipl ines ,  nractioners ,  ancillary  personnel,  committees,  and  administrative 
personnel.  The  Commander,  US  DeW’tt  Army  Hospital  is  recognized  as  the  delegated 
end  ultimate  authority  to  represent  the  governing  body  (Office  of  the  Surgeon 
General)  at  the  locol  levs'l.  Health  care  providers  will  participate  in  peer 
review  and  all  patient  care  processes  will  be  subject  potentially  to  evaluation. 


4  Definitions  and  Goals.  Evaluation  of  actual  performance  will  be  measured 
against  chnically  valid  criteria.  Clinically  valid  criteria  Is  defined  as 
standards,  objectives,  or  criteria  that  are  based  on  a  review  of  professional 
standards  ar.  '■eflcctad  in  current  clinical  literature.  The  criteria  "should  be 
expecseo  to  result  'n  improved  patient  care/cl inical  performance."  (JCAH  1981 
Manual,  p  !52)  Criteria  developed  within  the  hospital  or  ■'n  conjunction  with 
other  area  hospitals  may  also  be  used  as  appropriate.  Structure,  outcome,  or 
process  assessments  may  be  used  concurrently,  retrospectively  or  prospectively. 
Forma!  or  informa!  means  (or  studies)  may  be  used  in  investigating  tlie  known 
O'-  suspected  problem  area(s).  In  all  cases  written  documentation  will  be 
maintained  as  evidence  of  all  of  the  QA  studies  and/or  investigations.  Credit 
shall  be  given  for  QA  investigations  or  studies  which  result  in  the  finding 
that  no  significant  problem  existed  and  that  therefore  no  corrective  action 
is  required,  Both  informal  efforts  and  formal  studies,  as  appropriate  to  the 
situaticn,  can  be  used  in  the  QAP  provided  the  studies  and  efforts  are 
documented  in  writing.  It  shall  be  the  goal  of  DeWi tt  Army  Hospital  to  use 
app'Tpriately  both  the  formal  and  informal  approach  in  the  QAP,  Documentation 
ot^  OA  f  for'^.b  ^  bs  rc  f  1  oc In  oil  co^T^rni'ttO'i 

1  i-Ai.  FcMl-cv/  up  and  monitoring  activities  also  shall  be  eefiected 

•in  the  ninutes  to  determine  the  extent  of  improved  patient  care  euc/or  the 
need  for  additional  ntonitoring  or  QA  studies.  There  shall  be  no  specific 
nu:nber  nt  studies  required.  However,  co.mmittees  have  th^'  responsibility  to 
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conduct 


QA  act 


■'6?  that  a-'e  problem-focused  on  an  ongoing  basis. 


Eacn  cr.mcd!  d'sc'pHne  (.p-^ofessional  staff)  will  review  the  patient  care 
ft  provides.  Resu ;  re/ f’ndipgs  of  each  depa-'tment  on.QA  matters  wt  i !  be 
CGr-.Tumcated  -n  a  w'-rren  repoi^t  to  the  Chief,  Professional  Sei^v’ces  (CPS)  on 
a  qua^ts'-'y  bas’s  O''  mo'*e  frequently  as  directed  by  the  CPS. 


£dcn  ddm'nS-C’'dr ''ve  department  w.H  rev’ew  '  ts  operation  to  determine 
if  an/  QA  ttud'es  a'e  deemed  dpp^p*"!ate.  Departmental  or  '■nte ’"departmental 
QA  studies  will  be  ^n^tiated  and  /eported  by  the  admimstrafve  departments 
on  an  Ad  Hoc  bjf's  at  the  disc’^tion  of  the  administrative  depa'^tment  nead. 

An  annual  Summary  tf  a'’’  QA  studies  ac. ampl 'Shed  or  underway  will  be  forwarded 
to  the  EAecut'i-e  Off’cer  prror  to  December  of  each  year  by  tne  administrative 
department  heads. 

Department  chiefs  and  committees  w.  11  cooperate  in  conducting  interdepartmiental 
or  other  QA  studies  as  dfr-ected  by  the  Executive  Committee.’  In  addition,  the  CPS 
(for  clinical  stud'es)  or  the  Executive  Officer  (for  administrative  studies)  may 
task  deoartment  chiefs  or  committee  chairmen  to  conduct  QA  studies.  In  any-  case 
a  record  shall  oe  ma-fntained  by  the  Executive  Committee  of  all  proposed,  completed, 
and  rejected  QA  studies.  The  findings  (or  reasons  for  rejection  of  the  study) 
shall  be  documented  as  a  matter  of  record  for  review  by  the  OCAH  or  other 
authorized  inspecting  body,  follow  up  monitoring  to  document  improvement  in  patient 
care/ci'nical  performance  shall  also  be  directed  by  the  Executive  Committee  in 
order  to  'rsu'e  that  mod'f'cations  needed  to  enhance. the  quality  of  care  have  been 

accomp^r^p-.g^j 


husp'ra'i  Joni'r.u'-ng  Health  Education  (CHE)  Programs  will  respond  to  QA 
fnformat'on  -j  35  '0  address  areas  where  knowledge  deficiencies  are  noted  by  the 
QA  stud  es  OpcuiTenidi. ion  of  such  CHE  Programs  shall  be  forwarded  to  the  CPS 
by  department  uho'men  who  'n’tiate  me  needed  session  or  CHE  Programs.  This 
documentat’.C'''  oe  a  pa't  of  the  quarterly  written  reports  to  the  CPS, 


"g  tne  ma.t'mum  estent  poss'bie  QA  activities  shall  minimize  duplication  of 
efT'oi-r.  Cons ' de'at ■‘O'’-  should  oe  taken  of  the  potentia'’  benefn  cf  a  p'-oposed 
study  rthen  f..;mpd'ed  to  ire  cost  (time  or  other  resources)  of  conducr.  ng  the 
study. 

5.  Re-por.;  lb’ • ’'f'e; , 


a-  The  Co-mmander,  uSDAH  's  recogo’zed  as  the  de‘'eg3t--j  and  ultimate  authority 
to  reo'esent  the  go'S'r-ng  pruy  vO"5G)  at  tne  local  lev*- - .  As  such,  he  holds 
the  ultimate  responsi'br  1 ’■  t ^  tor  Quality  Assurance  Acf  'ities  wuhin  the  MEDOAC. 
Thus,  ne  v'na'il  make  ail  f  na'  teternr’naticns  of  the  -xtent,  ''f  any,  to  which 
outsi-ie  a'ds  ( -tonsu Kants  c-'  v,.  untary  revew  bodi:-  ,  foi"  example)  snail  be  used 
1.0  CA  activities  to  •q-aT'ry  -np/o''  assess  p'-nh'K’-s. 

0  "ne  Chief,  ' -"iressiond’  5e'’-/ice5  iCrS;  is  responsible  to  the  commander 
for  :ne  -tcnduct  a -d  -p 'ementat'on  of  the  QA  Program  and  for  compKance  with 
the  JC.’-ii  QiA  sta'Ka'ds  end  the  ri5C  directives  on  QA  matters  The  CPS  's  responsible 
for  me  cGord '  i.ii ’-tn  of  aM  QA  activities. 
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c  The  9<ecut''v/e  OTf<:or  (,.<0)  is  responsible  to  the  co'">nand9'''  insure  tiiat 

‘-''■J  -i  i.Or't 

d.  A)i  oepdi-rment  chiefs  and  committee  chairmen  are  re?;.ons'5T-  the  CPS 
fo'"  the  ■'mple'erT jfon  and  conduct  of  an  effective  QAP  wir,h:n  the'-  respective 
cepii'tmentE  and.-  committees. 

(')  Interdepa-t(T€ntal  QA  studies  (.proposed).  Appendix  A  specifies  the 
format  to  be  used  <n  submitting  a  proposal  for  an  interdepartmenta 1  study.  A 
depart-rent  ch'ef  or  a  committee  chairman  may  initiate  a  proposal  for  a  QA  study 
by  using  the  fomnat  shown  at  Appendix  A,  In  addition,  any  other  personnel  assigned 
to  USDAH  may  'nniate  a  proposal  for  a  QA  study  by  completing  the  QA  Study  Proposal 
(.0?^)  and  by  submitting  it  through  departmental  or  committee  channels.  These  will 
be  forwarded  to  the  HEC,  XO  or  CPS.  If  disapproved  for  study,  the  reason(s)  will 
be  documented  fo<  review  by  the  JCAH  or  other  authorized  inspecting  body. 

(2)  Reports  on  QA  Studies  Conducted.  Appendix  S  specif:es  the  format  to 
be  used  in  reporting  on  Quality  Assurance  Studies.  This  format  will  be  used  for 
studies  done  within  a  department  and  for  Interdepartmental  studies.  Committees  may 
elect  tc  oriefiy  summarize  a  problem,  solution  ana  follow  up  act'on  in  the  cwnmlttee 
minutes  if  r^solut'on  of  the  problem  can  be  determined  easily  (see  paragraph  7a{l)). 
Committees  are  encouraged  to  use  the  format  at  Appendix  D  when  feasible  and  appropriate. 
The  Executive  Committee  shall  determine  which  problem  focused  formal  and/or  in¬ 
formal  studies  should  oe  ''’itiated.  In  addition,  the  CPS  may  direct  QA  studies  in 
t.he  admin istrat've  areas  Department  chairmen  may  direct  QA  studies  within  their 
departments  or  in  cooperation.  wTth  arother  department{s) , 

6-  Acmipist'ation/Ccorci'r.atior.  of  the  QAP.  The  Hospital  Executive  Committee  shall 
insure  that  the  QAP  's  implemented  In  an  ongoing  manner  as  required  by  JCAH.  The 
Hosp'ta'.  Execut've  Comynittee  sha?’  also  insure  that  the  QAP  is  reappraised  at 
least  annua-'y.  The  'eapp.ra’Sa!  snaH  result  in  the  identification  of  "components 
of  the  Quality  Assu''ance  Program  mat  need  to  be  instituted,  (shall)  assure  that 
the  program  ongoing,  comprehensi ve ,  effective  in  improving  patient  care/ 

't'n-’.-a-  perfomndnce,  ard  conducted  with  cost  efficiency."  iJCAH  1981  Standard, 

PP  53-4, 

The  QA  Ccmm'ttee  snail  consist  of  the  membership  shown  at  Appendix  C.  The 
f’ow  of  QA  'nfo*marion  fo'-  committees  and  departments  is  shown  at  Appendix  D. 

Reie-ant  feedcdux  'n-'.-'  T-atior  tnouid  be  channeled  from  the  Executive  Committee  to 
department  cn'efs  ana  o-  to  cna'men  of  committees  so  that  the  QAP  U  comprehensive, 
integrated,  and  . 

7.  Implementation., 

a.  Herhodo'iogy  ^he  QAP  w’M  be  committee/department  onented-  Each  committee/ 
department  tvi'i  'n-r'ai’>  oe  •'equired  to  review  the  QA  standard,  1931  JCAH 
Aoc 'ed' ta'i  on  Manud'  ''or  Hosp'tals,  and  this  MEDCAC  Memorandum. 

U)  Committee  m'nutes/ report  format  will  make  a  statement  by  separate 
paragraph  (ert'tied  QijAl Tty  ASSURANCE)  to  the  effect  that  a  QA  problem  was/was  not 
identtf’ed  by  that  :cm.m''f^ee .  When  a  QA  problem  is  identified,  a  br-iof  summary  of 
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problem  dnd  proposed  soTut-oo  or  irathod  of  investiQ^tiod  will  be  included 
fo-'  subs-^quent  rs'i'ew  b;r  '-^’e  H^sp.jtijl  Executive  Committee.  This  paragraph  will 
also  snow  dpcuiner>tat’.!:Jn,'^yider^  dpTStetiun  reference  previous  problems. 

C2)  AU  coaw,Uti?€  reports  to  the  Hospital  Executive 

Committee  for  revte?/,  evaluation  and  coordination  of  QA'  ruatters.  The  Chief, ^ 
Professional  Services  in  coord-nation  with  the  Executive  Officer  will  establ ish 
and  periodically  update  priorities  with  regard  to  the  order  in  whichinter- 
departmental  problems  should  be  assessed4  The  Executive  Committee  will  direct 
comorehensi ve  studies  of  probVemi -to .affectied  committeeSjk  activities,  depart¬ 
ments,  and  divisions  and  will  asvl^  fo4*4tfoW.eJii. investigation 

and  resolution-  The  format  si^oivi  at  Appendix  A,  (Proposed  QA  Study)  may  be 
used  for  this  purpose  or  the  Uetnj^*ye  Cdwnittee  ahysiye  general  guidance  on 
the  known  or  suspected  problem  and  may  direct  those  assigned  to  prepare  a  report 
(Appendix  B)  based  on  their  investigation  and  .findings, 

(3)  The  Executive  Committee  will  direct  appropriate  follow  up  action 
through  Its  comfn(ttee  review  process.  The  Hospitdl  Executive  Coinniittee  will 
mcritor  problem  r-esolurions  at  least  once  during  the  siibseouent  ouarter  and 
during  the  annual  review,  .  - 

(.4)  The  Hospital  Executive  Committee  will  review  and  evaluate  the 
CAP  annually  during  December  beginning  in  December  1981.  During  the  annual 
review,  this  QA.  Mempvar.dum  will  be  updated  and/or  revised.  Documentation  of 
the  annua'  •'eds'seiii''erii  v»'!‘  tons'st  of -a  list  of  problems  identified  liuring 
the  past  iea'"  a  rurmbry  stat  iment  as  to  the  program's  impact  on  improvirjjf^.-  y 
dltnica'i  pe  ■''')•  IT, v  .i  pbL'ent  care,  The  above  documentation  will  be ‘niacje"^' - 
a  part  of  tf.e  mir'.'if'  of  the  Oec.embe"  Hospital  Executive  Committee  meeting.' 

The  Hospital  Exe'-.n'.e  Officei"  and  Chief,  Professional  Services  will  develop  ■ 
the  p'oolem  Wst  o  ad--br.<e  ut  the  QAP  annual  review. 

B  Proolein  Idem  ifif.at 'on  there  are  n<^ spec! fic  numerical  requirements 
w-'tFi  regard  tc  QA  problem-.  Dc-W  ti  .Army  Hospital  should  identify  annually.  The 
cinnuj!  goj-  uf  DeW  Amg  Hospital  will  be  to  identify  and  resolve  a  minimum 

QA  proo'em  per  horpifj-  roinmittee,  with  the  exception  of  the  Medical 
Ltb-'ary  Cjmm’.rce&,  tne  Acc  recii  cat ’on  Committee,  and  the  Health  Consumer 
Committee  ihe  aica.hed  i  ‘.-t  of  data  sources  (Appendix  E)  will  assist  in 
problem  frienti f^'caciun  C  oiiua  ly  valid  criteria  will  be  used  to  -deiitify 
and  assess  p.-ob-ems,  The  QAP  will  focus  primarily  on: 

,.  <...  p,- .red  problems  (not  limited  to  diagnoses  or  procedures). 

■;;il  P  opiemti  for  rrnich  the-'e  are  local  solutions, 

(3 1  Propiems  that  adversely  ’.mpdct  on  patient  care  or  benefits. 

....iQig.n  -ocused  Approach,  "he  problem  focused  approach  is  bo  be 
'jr.Mtzad  for  all  QA  stud'e-^  A  problem  is  defined  as  any  deviation  from  an 
expected  desirable  outcome  or  an  area  of  concern..  The  problem  focused  approach 
is  Based  on  the  assumption  that  to  obtain  maximal  benefit  from  a  QA  study 
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emphas"^  muiC  be  focused  on  the  reiolution  of  known  or  suspected  problems.  In 
addfti'on,  due  to  '•eiOc^'je  1  <m> tai 'ons ,  pr’orities  must  be  established  so  that 
those  problems  having  me  mc?i  'nvned’.ate  and  adverse  impact  on  patient  care 
will  be  stud’'ed^;rsc 

(.1)  ProbleiH  Mcat'on  Problem  identification  should  be  encouraged 

at  all  levels  within  tne  health  care  organization.  Departmental  and  service 
chiefs  will  formulate  and  ''mpiement  a  mechanism  for  encouraging  problem 
Identification  and  supm-it,  proDieni  lists  with  priority  rationale  to  the 
Executive  Comnrttee  fojr  further  priorttization.  Problem  identification  is  to 
be  concur. 'ent  and  ongo'ng. 

(21  problem  P  •  •'O'’ '■  t  <2at’ on ,  A  problem  list  will  be  formulated  and 
maintained  in  order  to  Insure  that  the  hospital  QAP  encompasses  all  organizational 
elements  and  that  resources  a'e  utilized  for  maximum  benefit.  The  CPS,  Director 
of  Nursing,  and  XO  w'li  compiie  the  problem  lists  and  niconmend  study  priorities. 
The  Executive  Committee  will  review  the  current  list  at  each  monthly  meeting  and 
will  make  changes  as  needed,  Ord'narily  the  establishment  of  priorities  for 
profclerr,  resoiui’cn  ‘'hjll  be  raVt&d  to  the  degree  of  adversp  impact  on  patient 
care  that  can  be  expected  if  the  problem  remains  unresolved. 

8.  Other  Quality  Assu-ance  R&spons 'bil 'ties.  The  Executive  Committee  wi 1 1  insure 
that  the  staff  and  ai’  committees  comply  with  OCAH  evaluations  required  at  the 
prescribed  r'eqi.ienc''t  c  -.ee  Append’ <  ,p) 

9  Reporting  Pr-ocedu'-e  'ih'i-e'"' s  "O  spec’f'c  number  of  QA  studies  which  must 

be  completed  n  -o  '.omp  y  w’^h  6«'siing  requ’ reirents.  The  HEC  will  mon’tor 

the  enti'e  QAP  ro  "nru'e  that  ai'  organizational  elements  are  mvoUed,  QA 
studies  should  tie  ro'm.i'  sh.w  at  Appendix  A  and  Appendix  B.  Reports  will 
be  submitted  a'ong  rce  o- .j.;'’  Zat  "ona'  '''nes  identified  'n  the  Quality  Assurance 
rnformatior,  Flow  Cba't  iwppendu  D  Alternate  infonnal  reporting  pathways 

may  be  ufi'^ed  whe-nfe  c-i'  -.pp  jp-'ate  tv  facilitate  the  maximum  exchange  of  in- 
fomiatioh-  Ail  QA  w  ■  ce  treated  as  sensitive,  confidential  information 

to  be  made  I'.a  ac  p  to  lu’to  rd'v-’duals  with  a  legitimate  "need  to  know". 

The  CPS  vi'.il  'oo'ci  d'  QA  -epo'fng  activities,  The  HEC  will  serve  as  cus¬ 
todian  of  all  QA  'Hpv  i ari'i  0..  ijiiient^ 

10  P-'oblem  kpkj  uf  •.<  I'f -u  ut  on  of  p'oblems  may  require  any  or  all  of  the 
fol lowing  I 

a  New  ■  e .  ■  'Hd  SOP  i 
b.  Statfing  change.', 

(,  Tqu ipiten t .  t  r( .  1 '  t >  i.bnr.ges 

■  1  .  inr  “  I  .'ins  V  ’  '  ^’'les  1 

e.  Educdt'on  and/O''  tfg'n’ng  programis 

Contmiji  nq  Medina'  Education  iCME/  -.ind.  or  craining  programs  will  be  used  as 
appropriate  as  a  veh’c  e  fo'  resolving  p'oblems  noted  in  QA  studies  or  other 
Qa' acrivVfes  Doc  umentat 'on  of  CME  relevant  to  QA  matters  will  be  accomplished 
through  committee  m-nutes  and,  or  depa'tmental  channels  as  apprnpri  ,ite . 

b 
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n.  Self  Assessment  of  QA.  (See  Self  Assessment  Matrix  (as  of  Sep  1980)  - 
Appendix  G.) 

a.  The  Executive  Committee  will  Insure  that  QA  information  (input  and 
feedback)  is  shared  in  an  appropriate  manner  with  other  committees  and/or 
departments  in  order  to  facilitate  communication  on  QA  matters  that  may  result 
in  improvements  to  care  and/or  the  operation  of  DeWitt  Army  Community' Hospital  - 

fa.  The  Executive  Committee  will  review  the  Self  Assessment  Matrix  at 
least  quarterly  to  determine  which  committees  be  combined  or  made  sub- 
corrmittees  of  another  committee  in  oroer  to  avoid  or  reduce  duplication  of 
efforts  by  those  committees. 

c.  Additionally,  the  Executive  Committee  will  review  the  Self  Assessment 
Matrix  at  least  quarterly  to  insure  that  the  flow  of  information  and  other 
aspects  of  the  Matrix  meet  the  spirit  and  intent  of  current  JCAH  requirements. 
Recommended  changes  should  be  communicated  to  the  committee(s)  involved. 

12.  References  and  Autnority. 

a.  AR  40-66,  Chapter  9,  "Quality  Assurance" 

b.  JCAH  Accreditation  Manual  for  Hospitals,  1981 

c.  MEDGAC  Memo  15-‘,  MEDDAC  Committees,  Boards,  Councils,  and  Conferences, 

9  October  1980 

d.  MEDOAC  Policy  No.  40-401,  Quality  Assurance  Plan,  22  Apr  80  (Ft  Meade 
MEDDAC) 

e.  Ltr,  Subj  Implementation  of  the  New  JCAH  Standards  on  Quality  Assurance, 
22  Feb  80  (HSOP-PR) 

AHDCM-AR 

FOR  the  COMMANDER: 


:3UT!0N: 


MA^IGA^T  A.  MAGGIO 
ILT,  MSC 
Adjutant 


( 


i 


•/ 


DISPOSITION  FORM 


F«r  UM  wf  thh  form,  M*  A  R  34«-1 9:  f ho  vrooonont 
(•or>«Y  l»  Tho  A^lufont  Oonorol  Cootor. 


REFERENCE  OR  OFFICE  SYMBOL 


SUBJECT 


Proposed  Quality  Assurance  Study  (Subject  of  Study) 


xo  CPS  from  oath  cf-m 

XO  or  Executive  Committee 

1.  Probleiii;  Cstate  briefly) 

2.  Ho?v  Identified:  (Department,  committee,  complaints,  etc.) 

3.  Ofajective(s]  of  Study: 

4.  Criteria:  (Examples:  JCAH  Standards,  SOP's,  AH’s,  Local  staff  consensus  or 
opinion ,  audit,  etc. ) 

5.  Resources  Required: 

a.  Personnel  (List  recommendations  of  personnel  to  conduct  study) 

b.  Time  (Estimate  the  time  needed  to  conduct  study  and  report  findings) 

c.  Equ'pinenL/Suppiifes  (Esc (mate  costs,  if  aoplicuble) 

d.  Other  (List  other  departments  involved  and  list  other  pertinent  resource  casts  net 
previously  identified) 

6.  Recommended  Priority:  (Within  department/hospttal  or  other,  Discusi  impact  if 
problem  is  not  studied) 

17.  Other  Comments:  (If  any) 


lief.  Department  or  conmutee 


FROM  CPS '  DATE 

XO  or  Executive  Comn.Ittee 


CHT  2 


1.  Study  is  approved/d fsapproyed/deferred  at  this  time.  NOTE;  IF  APPROVED,  THE  PRIORITY 
ASSIGNED  WILL  BE  NOTED,  f^:  IF  STUDY  IS  DISAPPROVED  0R"WtRRED  THE  REASON  WILL  BE 
STATED. 


2.  Chairman  for  study  ts  _ .  Others  on  committee  are  _ 

_ _ _  »  --  _ _ _ 

3.  Departments  involved  ln  study;  (Specify) 

ji.  T^nstraioc^ :  'Optional  oaraqraph.  E/.ampla:  -.onstrafnts  on  '^sources 


>  etc. 


5,  Suspense  date  Tor  completion  of  study  is:  (Specify) 


lAPPENDIX  A 
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CPS  or  XO 


RgPLACES  DO  Eonv  99,  WHICH  13  09S01.ETE. 


DISPOSITION  FORM 

Fwu»*o*tM«  form,  M*  AR  340-1 9;  tho  oroponont 

■0<w<V  It  Tb#  Ad|yf  nt  0«p«nil  Ctnttr. 


REFERENCE  OR  OFFICE  SYMBOL 


TO  CPS 

XO  or  Executive  Committee 


1.  Problem: 

2.  How  Identified: 

3.  Object! ve(s)  of  Study: 

4.  Criteria: 

5.  Resources  Required: 


SUBJECT 

Report  on  QA  Study  (Subject  of  Study) 


NOTE:  The  first  6  paragraphs  may  be  omitted  i_f 
previously  documented  in  a  QA  proposal.  (See 
Appendix  A)  However,  for  studies  done  within  a 
department  and  reported  upon  completion,  all  of 
the  paragraphs  will  be  shown. 


6.  Priority:  ^ 

7.  Actions  Taken:  (Examples:  Samples,  audits,  design  of  study,  etc.) 

8.  Results:  (What  you  found) 

9.  Corrective  Actlon(s):  (List  actions  taken,  if  applicable) 

10.  Recommended  follow  up  actions  to  determine  effectiveness: 

a.  Short  range : 

b.  Long  range:  (Indicate  ttme  frames  and/or  frequencies  of  monitoring.  Specify 
bow  follow  up  Is  to  be  accomplished.) 

NOTE;  Other  paragraphs,  if  appropridte,  may  be  added  to  those  shown  above. 


Chairman  of  Study 

TO  FROM  CPS/XO/HEC 

1.  Identify  plan  for  review  and  further  action  or  follow  up. 

2.  Establish  suspense  date  if  appropriate. 


CMT  2 


APPENDIX  3 


DA  1  2496 


rttFLAC'j'?  DO  FORM  SW,  WHICH  IS  OBSOLETE. 


TO  CPS/XO/HEC 


FROM 


DATE 


CMT  3 


1.  Provtde  details  of  follow  up  and/or  monitoring.  State  if  further  monitoring  . 
should  be  continued  and  give  recommendations  (type  of  follow  up,  timing,  frequency, 
etc.). 

2.  Other  comments  are  optional. 


Chairman  of  Study 

TO  FROM  DATE  CMT  4 

1.  Prescribe  plan  for  continuation  of  follow  up  or  further  investigation. 

2.  Note  that  problem  has  been  resolved  (or  that  no  problem  was  found  to  exist  upon 
investigation) . 


CPS/XO/HEC 


QA  COMMITTEE  MEMBERS 


Commander,  US  DeWttt  Amy  Hospital 

Executive  Officer 

Chief,  Professional  Services 

Chief,  Department  of  Nursing 

Administrative  Resident  (non  voting  member) 

Secretary,  MEDDAC  Commander,  Recorder  (non  voting) 


NOTE;  THE  ABOVE  MEMBERS  ARE  ALSO  MEMBERS  OF  THE  EXECUTIVE  COMMIHEE 


APPENDIX  C 
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FLOW  OF  INFORMATION  OF  COMMITTEES 
(Effective  1  January  1981) 

Hospital  Executive  Committee 


>  Util ization  Review  ^  — I 


Ir'edentials  Committee^  ~ 


- ^ 


^ - 


t 

I  ■ ' 

I 
I 
I 

4, 


t 

-  CPS 

n 

All  Clinical 

Departments 

'1' 


I 

1 


L-  _ 


T 

-  —  XO 

tt 

All 

Administrative 

Departments 

-  ~  /JV 

1 

^ - 1 


Patient  Care  Auditing  (MCE  Committee) 
lAB 

Infection  Control 
Nursing  Audit 

Ambulatory  Care  Committee  -- 

Blood  Transfusion  and  Tissue/ 
Statistical  Review 

Cancer  Committee 

Clinical  Investigation  Subcommittee 
Tumor  Board 


Accreditation 

Automacion  Guidance  Cuuncil 
Civilian  Training  Committee 
Crime  Prevention  Council 
Disaster  Planning  Committee 
Energy  Conservation  Council 
Health  Consumer  Committee 
Jo’nt  Staff  Conference 
Labor  Management  Committee 
Linen  Management 
Medical  Library 
Planning  Committee 
Professional  Education  Committee 
Program  &  Budget  Advisory  Committee 
Safety  and  Fire  Prevention 


Foma  I  Flow 
•  Informal  Flow 


APPENDIX  D 


QA  DATA  SOURCES 


Kedtcal  Records 

Pharmacy  Prescrtpttons 

Patient  or  Practitioner  Profile  Data 

Nursing  Audits 

Risk  Management  Reports  or  Studies 
Financial  Data 

Letters  of  Complaint/Comment 
Medical  Statistics 
Blood  Utilization  Review 
Infection  Control  Findings 
Radiology  Reports 
Utilization  Review  Studies 
IG  Reports 
AAA  Reports 

Mortahty/Morbtdity  Review 
Profile  Analysis 


Committee  Findings 

Current  Literature 

Medical  Audits 

Incident  Reports 

Ancillary  Services  Requests  and 
Reports 

Patient  Surveys  or  Consents 

Personnel  Staff  Interviews 

Tissue  Review 

Safety  Findings 

Labcrat0’"y  Reports 

Other  Diagnostic/Clinical  Reports 

Internal  Review  Studies 

JCAH  Survey  Recommendations 

Observations 

Review  of  Treatment 


appendix  t 
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HOSPITAL  VVIDE  FUNCTIONS  REQUIRING  MEDICAL  STAFF  PARTICIPATION 


ACTIVITY 

FUNCTION 

Fi. .  ..  .ENCY 

InteciiOf'  Control 

(Infection  Control  Stjn<i.iKi  .1^ 

RtivHjw  infections  vnthin  ihe  hosp«tal,  cultures  of  p<*fsoMnrl  ©r 
the  environment,  results  of  any  antimicrobial  susceptihility^ 
resi'itrinco  trend  studies,  ivopo^als  and  protocols  for  all  special 
infection  control  studies  conducted  throughout  hospital 

* '  C  '  .  •  ^  ■  *' 

i.»c  t  •  rji'ths 

Sal*i:Y 

Cornmi',(ee 

(Fonct'unal  Safsty  and  Sanitation 
StondanI  1) 

Adopt.  imnlp*'T)ent,  and  monitor  a  comprehensive,  hospital  wide 
safety  program 

0i»il5t«r  PlunninQ  (f^•■*chJnn^n 

nut  SpWCili'id) 

(Functional  Safety  and 

Sjnitation  Standard  III) 

P<on  for  external  and  interna!  disasters,  and  rehearse  and 
evTiu.ne  all  drills 

"  .*/•  •  .r ..  'K 

V-?'  f  ■  'ffl  il* 

O.iu/'..  'trshi’’ 

►■jf  ^  ■  /'  g 'ir/*.rr',-S 

Ullli^ation  R*;viaw  Pro.yarti 
(Utilization  Review  Standard  )) 

Address  overutilization,  underutilization,  and  inefficient 
scheduling  of  resources 

Dt^lineate  responsibilities  for  discharge  planning 

An:  jj’  and 

-.•VJ.  ^  *  .I  -  on«}o»ng 

Ut‘J  J*  w  ' 

SUPPORT  SERVICE  EVALUATION  FUNCTIONS 

PERTINENT  CHAPTER 

SOURCE  OF  EVALUATION 

» 

Fl-..  .‘jf.NCY 

An(!jth»iia  S«rvic«5 
(Standard  1) 

Prat>i,tablith«d  criteria 

Ouirte.i . 

Di'M'Jtl.;  S'!fvi';'ii 
(S'jnd'itd  VII 

|M|njt  of  (iiHcJical.  nur'i'C'i,  and  diilclic  '.lal'i 

Outsidu  lourcat  if  uied 

Medical  record 

l\'  'l.ta  • 

F.mertj^ncy  S^fvicet 
'Standa-d  VI'l) 

Pri'Hstahinhird  eritana 

Uie  ot  medical  record 

Mo^th-y 

Mor**  f.c’  .ently 

wh‘*npl.,  ,..in 

lurnov.  *  V‘‘ 

'  1 

Care  Serv.i.ys 
iSrondiird  V) 

Pjtient  records,  both  active  and  closed 

••  .  - -  .  I - 1 

Ot»ar;«dy 

NePt*  I  lu*  standard 
also  reuu  res  annual 

i.’vril'jai'Ofi  jf  progrjri 
nbi*fct'‘.es  tiy  n  fTu«ti* 
disr.iplmary  advisor/ 
Cof”r-ii*tcu  and 
nt  oa^'Hor  t^lAns 

nnT  *1  nuenMy 

til  m  Ci'J  d  1  rs 

r‘'.50i'll  ioun^of-'d 
^Vmoul.norv  Core 
‘‘•:rvic*t5  IStand.uH  /') 

'.'v:  innsHMii  cnterui 

Um*  nf  medical  record 

■  .  1  •  'M  Illy 

M  ;'<'  ‘  .  ntly  when 

•.  rvii--'  ‘  >roani;ed  by 
'•[  ■•••rvices  or  has 

oitTu-ifh  ur-nrams 
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SUPPORT  SERVICE  EVALUATION  FUNCTIONS 


PERTINENT  CHAPTER 

SOURCE  OF  INFORMATION 

FREQUENCY 

S-ffw!C#i 

'St.indard  D 

Review  and  evilujtion  of  lervicel  provided  as  docuinented 
by  director 

fjiu  Gi’fuified 

P •ind  M»‘dical 

L  Servicel 

‘Scjnd.ifU  1) 

Review  and  evaiuation  ot  the  quality  and  jppropriatenesj 
of  servicet  rendered  by  the  director 

Nnt  specified 

Phdfn'aceiiliCjl  Ijxivicos 
(Standard  III) 

I’articlpi'itiun  tiy  phai  rent  in  inosa  atpocti  o(  the  overall 
quality  etauranco  program  that  relate  to  driij  utilir.Hion  and 
eficctivenait 

Hot  spncilitKl 

nadiologv  S«tViC«» 

(Slindjrd  1) 

Review  and  evaluation  of  quality  and  .ippropriateneti  of 
radiologic  tervicee  by  dirvetor  •' 

Not  specified 

R<h4billtition  Proqrtm 

Servicil 
(Standard  1) 

Preiitabliihed  criteria 

Involvement  of  medical  ftaff  and  rehabilitation  personnel 

Ouartarly 

Hatpiratory  Car*  Sarvic*] 
(Standard  VI) 

Preestabllihed  eritarla 

Involvement  of  tnedical  staff  and  respiratory  care  personnel 

Ui#  of  medical  record 

Ouarterly 

Social  Work  Sarvicai 
(Standard  VI 

Preestablithed  crit*rl* 

Use  of  medical  reeorrf 

Uutside  services  if  used 

Twice  annually 

Special  Car*  Uniti 
(Standard  III 

Review  and  evaluation  of  the  quality,  safety,  and  approp'iatenvsi 
of  the  patient  care  within  the  unit  as  related  to  the  findings  of 
hospital  and  medical  Italf  qualib/  and  safety  assessment  .ici.vititt 

Hegijlarly  (ly 
physii'lainjireetor 

Ouai  nrrlv  Isy  rriullh 
dist.plinary  commitliu 
(lor  a  miiliiourpote 
ioeol,il  cate  unit) 

NURSING  EVALUATION 


ACTIVITY 

FUNCTION 

— 

PR'-QUENCY 

D‘'0^rtm^rTt/S»frv*ce  Mattings 

l(jentify  probkfni;  propose  lolutiom 

At  li'ist  SIX  times  a 

(flur'.ing  Services  Srardard  II) 
(May  he  performptf  on  depart- 
inent/service/iinit  level) 

Consider  findings  from  tclevant  nursing  care  and  morsitnring 
activilies 

V«Mr 

ni)vti}/>  tiMfJ  tvalur'jtion  -jf 
'  j'.Kttn'i  Hf.i^»ic»’  t*i'd 
i  ■,fir;(ion^ 

^  ’  iiji’iinq  rorvfr»»\  Staf'Tj.ird  VII) 

Exjmin#  fhp  provision  of  our^inq  care  nnrJ  iu  on 

p.ibtfnts 

At  luriif  du.jr’.yrly 

/'NL*  I'l  J  eVhfjlft,  bv 

ftr  b/  nufiiOT^ 

■  •  ill  fn  fjKbJft* 

.•••/  **w  '4u.|(»tv  ifvi  >riorr)uri.i('*nHSS  •)!  ,*  Jf»t  iJfOvtOttfJ  <jy  Muf ^it  q 

j.'f^Dnr.L'i  r*eff  <-  1 V '■»!  ‘’fOplOy'Hl 

- .  -  --- 

F  2 


W 
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MEDICAL  STAFF  EVALUATION,  ASSESSMENT,  AND  MONITORING  ACTIVITIES 


ACTIVITIES 

FUNCTION 

FREQUENCY 

Lxt'rui  /tf  Cofnini{»ee 
li'/c'dicjl  Jj.andard  li) 

R«ceivi»  CiHd  act  tDoa  reoofli  and  ftfCom/r*f*nthtion5  fr :  »n  mediCwl  stat* 
committees,  dwpartmerrtt,  sfervlres.  .‘if'd  avMtined  activity  groups 

MofU’niy 

Mfi  ':al  jtiM  T)  •parinunl! 

;  staffl  o' 

( ''Of'<1opd  - ‘.IIP n tail 

‘.'jlO 

(M  -JiCjl  StaC  Standard  m 

Raview  patient  care  and  treatment 

■Vainin.n  record  that  ioclodei  resultant  recommencfatltnn, 
concluiioni,  and  action  instituted 

' 

Montrly 

I  ‘A  .'i'ljnaiptl  ^'pc''lnn^^s  o<  tho 
MeiJical  Staff 

iMptlical  Staff  Standard  IV) 

Evraluate  patient  care  tfirouiift  specific  studies  usiriq  pruustablisiied 
criteria 

Monitor  elements  of  patient  care  identified  in  staff  or  depertment,' 
service  rules  and  requlationt 

Oontinuou^V 

T'iiu*  Review  Function 
(surgicat  ca&t!  rt^viaw) 

Perform  review  on  cases  in  which  a  soecinien  (tissue  or  nontistue) 
was  removed,  as  well  as  cases  in  which  no  specimen  was  removed 

Monthly 

P'^arm.-ay  an'l  T'terapr. ci 
Function 

(Spa  ai'io  Pharmach'jtkal 

Sff'vicai  Standirrfj  III  ■  V) 

Ce.i.lo,?  ind  s  rvey  At-macy  ind  therap •  ut'e  pc' ties  ar  d 
orocedures  letated  to  the  selection,  intrahospitai  ifistriliution 
and  handling,  .ind  safe  administration  of  drugs 

Evaluate  and  approve  all  protocol',  concerr  ing  use  ol  in'acstigational 
or  experimental  drugs 

Qua.  or 

rroru  ffiiiT.nfntly 

Madieal  Racard  Function 
(Sea  alio  Madlcal  Record 

Sarvcpl  Standaids.1  •  111) 

Review  medical  records  for  timely  tomplc-iau,  uMnical  onitlnence, 
and  q.yai  all  adequacy  lor  quality  assuianue  activities 

Ouaite'tv  or 

more  (•enuentlv 

Bloo'J  Unlira’‘on  Revipw 

Review  blood  tr,insluiions  (or  pror^er  m.i  raiion  with  proper 
.attention  to  use  of  whole  blood  vei'-'...  coii  pune'ii  blood 
dements 

Orjiliirly  :r 
'orire  'rcouently 

Evaluate  bloorl  use,  including  a  rev.-v.  of  '  ;  amc-nt  of  blood 
requested,  amount  u'ed,  and  .imourit  of  wastaga 

Antibiotic  R»?‘/i'j^ 

Establiih  criteria  for  proohvlact'c  dod  IherjWJUtic  ir.i?  of  iinT»b»u»ics 
m  pioblem  and  rsviffw  danarturei  from  thevM enter'* 

Orujot'^fj  uwjcie 
siscjsff'vnt 

F-3 


no 


/ 
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APPENDIX  B 

PROPOSED  QUALITY  ASSURANCE  STUDY 


DISPOSITION  FORM 

r^r  'jm  9^  Thl*  ♦o^m,  999  AH  340*11; 

it  Th»  AUi  .tint  0#nT»i  C^ntT. 


HEFERENCE  OR  OFFICE  SYMBOC 


SUBJECT 


Proposed  Quality  Assurance  Study  (Subject  of  Study) 


TO  CPS 

'^0  .ir  E^eciit've  Conriittee 


FROM 


OATS 


CMT  1 


1.  Pi'ob'f-':  estate  briefly) 

2.  Kow  .'  Jenttfted:  uDcpartirent,  committee,  comp! eiints,  etc. ) 

.1.  OL'jo  :t  tV6(s)  of  Study: 

4.  Criteric,;  (Examples:  JCAH  Standards*  SOP'S,  AR's*  Local  staff  consensus  or 
opinion  ,  audit ,  etc. ) 

5.  Kesources  Required; 

a.  Personnel  (List  recommendations  of  personnel  to  conduct  study) 

b,  Tfrne  (Estimate  the  time  needed  to  conduct  study  and  report  findings) 

c.  Equfpment/Supplles  (Estimate  costs,  if  appUcable) 

d,  Other  (List  other  departments  Involved  and  list  other  pertinent  resource  coifts  net 
previously  Identified) 

C.  Pucommended  Priority:  (Within  dopartment/hospttal  or  other,  Discuss  Impact  If 
problem  Is  not  studied) 

7.  Other  Comments:  (If  any) 


TO 


cFiTeT,  Department  or  CbfurntUee 


moM  CPS  date 

XO  or  Executive  Committee 


CMT  2 


1.  Study  is  approved/d isapproved/doferred  at  this  t1n>.‘.  NOTE:  IF  APPROVED,  THE  PRIORITY 
ASSIGNED  MILL  BE  NOTED  NOTE:  IF  STUDY  IS  DISAPPROVED  OR  WFtRRED  THE  REASON  WILL  BE 
STATED. 


2.  Chairman  for  study  Is 


Others  on  coiriiilttee  are 


,  etc, 


3.  Dopartments  involved  In  study:  (Specify) 

4.  Con-'tfalnts :  (Optional  poraqranh.  Example:  Constraints  on  resources) 

5.  fuspansp  daio  for  coiipW’tion  of  study  is;  (Specify) 


iPPENDIX  A 


CPS  or  XO 


DA  2496 


Bii’LACSS  00  FORM  »C.  WHICH  IS  OlWOLETIi. 
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APPENDIX  C 

REVISED  QUALITY  ASSURANCE  PLAN 


•MEDDAC  Memo  ftO-91 


DEPARTMENT  OF  THE  ARMY 
Headquarters,  US  Army  Medical  Department  Activity 
Fort  Belvoir,  Virginia  22060 


Memorandum 

No.  40-91  1  March  1982 


Medical  Services 
QUALITY  ASSURANCE  PLAN 

1.  Purpose*  The  purpose  of  this  memorandum  is  to  establish  a  written  plan  that  will 
serve  as  basis  for  a  comprehensive,  fully  integrated,  problem-focused  approach  to  a 
Quality  Assurance  (QA)  Plan  for  US  Army  Medical  Department  Activity,  Fort  Belvoir, 
Virginia. 

2.  General.  The  overall  goal  of  the  Quality  Assurance  Program  (QAP)  is  to  demonstrate 
this  MEDDAC's  comprehensive  and  integrated  approach  to  quality  assurance.  The 
principal  objective  of  the  QAP  i?  to  facilitate  the  ongcing  identification  end  assessment 
of  problems  associated  with  clinical  performance  and  the  delivery  of  health  care  with  the 
intent  of  improving  such  care  to  an  optimal  level  within  available  resource  constraints. 

3.  Scope.  The  QAP  involves  all  organizational  activities  that  are  designed  to  foster  or 
evaluate  health  care.  It  includes  all  departments,  disciplines,  practitioners,  ancillary 
personnel,  and  administrative  personnel  assigned  or  attached  to  the  MEDDAC,  Fort 
Belvoir.  Health  care  provides  ^ill  participate  In  peer  review  and  all  patient  care 
processes  will  be  subject  potentially  to  evaluation. 

4.  ResponsibUides. 

a.  The  MEDDAC  Commander  is  recognized  as  the  delegated  and  ultimate  authority 
to  represent  the  governing  body  (OTSG)  at  the  local  level.  As  such,  he  holds  the  ultimate 
responsibility  for  quality  assurance  activities  within  the  MEDDAC. 

b.  The  Executive  Officer  is  responsible  for  administrative  actions  in  support  of  the 
QA  Plan  and  for  insuring  the  availability  of  resources  necessary  to  carry  out  the 
provisions  of  said  plan. 

c.  The  Chief,  Professional  Services  will  serve  as  chairman  of  the  QA  Coordinating 
Committee.  He  has  the  authority  to  direct  such  actions  as  are  deemed  appropriate  to 
achieve  the  goal  of  the  QAP. 

d.  Division/department/activity  chiefs,  to  include  the  QIC's  of  Fort  A.  P.  Hill  and 
Vint  Hill  Farms  Station  Health  Clinics,  are  responsible  for  implementing  the  procedures 
outlined  in  paragraph  5  below. 

e.  The  QA  Coordination  Committee  (see  organizational  chart  at  Annex  A)  will  be 
-•snonsible  'or  the  following; 

(1)  Overseeing  all  aspects  cf  the  QAP,  to  include  reviewing  current  QA 
activities,  setting  priorities  on  MEDDAC-wide  QA  actions,  and  directing  actions  to  be 
taken  in  resolving  identified  QA  problems. 

♦This  Memorandum  supersedes  MEDDAC  Memorandum  40-91,  dated  22  December  1980. 
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MEDDAC  Memo  'K)-91 


1  March  19*2 


(2)  Reviewing  and  evaluating  the  QA  Plan  annually  during  the  month  of 
December.  During  the  annual  review,  thi.s  memorandum  will  be  updated  and/or  revised  as 
necessary.  Documentation  of  the  annual  reassessment  will  include  a  list  of  problems 
identified  during  the  past  year  and  a  summary  statement  as  to  the  program’s  impact  on 
improving  clinical  performance  and  health  care.  The  above  documentation  will  be  made  a 
part  of  the  minutes  of  the  December  QA  Coordinating  Committee  meeting. 

f.  All  MEDDAC  personnel  must  abide  by  the  procedures  established  herein,  remain 
cognizant  of  any  problem  which  has  or  could  have  a  negative  impact  on  the  delivery  of 
optimal  feasible  health  care,  and  communicate  said  problems  to  the  QA  Coordinating 
Committee. 

5.  Procedures. 

a.  Each  division/department/activity  chief  will  establish  a  QAP  to  assess  health 
care  and  identify  QA  problems  within  their  own  areeis  of  Interest  and/or  in  other  areas  of 
the  MEDDAC.  The  functioning  of  this  program  will  be  based  on  guidance  provided  by  this 
momcrandurn  anJ  a  ill  be  outlined  in  an  internai  SOP.  Copies  of  a  sample  QA  SOP  (Annex 
B)  and  minutes  of  a  departmental  QA  meeting  (Annex  C  without  inclosures)  are  attached. 
Departmental  QA  meetings  will  be  conducted  on  a  regular,  but  not  less  than  quarterly, 
basis.  Copies  of  minutes  of  departmental  QA  meetings  will  be  routt^d  to  the  QA 
Coordinating  Committee.  Intradepartmental  problems  identified  for  further  study  will  be 
reported  to  the  QA  Coordinating  Committee  by  completing  Sections  I  through  III  of 
MEDDAC(CSD)  Form  522  (see  Annex  D).  QA  problems  thought  to  extend  beyond  the 
preview  of  individual  depar  .ments  will  be  recorded  in  Section  I  of  MEDDAC(CSD)  Form 
522  and  forwarded  to  the  QA  Coordinating  Committee  for  action. 

b.  The  committees  and  support  services  listed  at  Annex  1:  will  forward  an 
information  copy  of  their  minutes/periodic  reports  to  the  QA  Coordinating  Committee. 
Applicable  HCAH  evaluation  criteria  and  reporting  frequency  is  specified  at  Annex  F. 
Committee  minutes/report  format  will  include  a  paragraph  summarizing  QA  issues 
addressed.  QA  problems  identified  for  further  study  will  be  reported  as  specified  in 
paragraph  5a  above. 

c.  An  individual  identifying  a  potential  QA  problem  may  report  the  problem  in  one 
of  two  ways; 

(1)  To  his/her  department/division  chief  for  inclusion  into  the  departmental  QA 
meeting  or 

(2)  Directly  to  the  Chairman  of  the  QA  Coordinating  Committee  (CPS). 
Format  for  this  report  will  be  as  described  in  paragraph  5a  above. 

d.  Upon  receipt  of  MEDDAC(CSD)  Forms  522  by  the  QA  Coordinating  Committee, 
identified  problems  will  be  reviewed,  evaluated,  and  prioritized  with  regard  to  the  order 
in  which  assessment  will  take  place.  The  QA  Coordinating  Committee  will  direct 
cornpr“hersi ve  integration  of  problems  to  .ill  interested  departments/divisions/activities 
■I'd  i'Sign  responsibility  for  problem  resolution.  The  QA  Coordinating  Committee  will 
direct  .appropriate  follow-up  action  through  its  committee  review  process  and  will 
periodically  monitor  problem  resolution.  All  problem  resolutions  will  be  evaluated  during 
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1  March  1982  MEDDAC  Memo  40-91 

the  annual  review.  Administrative  operation  of  the- QA  Coordinating  Committee  will  be 
governed  by  the  provisions  of  MEDDAC  Memorandum  15-1. 

6.  References. 

a.  AR  40-66,  Chapter  9,  "Quality  Assurance" 

b.  JCAH  Accreditation  Manual  for  Hospitals 

c.  MEDDAC  Memorandum  15-1,  MEDDAC  Committees,  Boards,  Councils,  and 
Conferences 

HSXA-AR 

FOR  THE  COMMANDER! 


6  Incl 
as 


MARGARET  A.  MAGGIO 

CRT,  MSC 

Adjutant 


DISTRIBUTION: 

A 
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ANNEX  A 


I.  Organization 


II.  COMPOSITION  OF  QA  COORDINATING  COMMITTEE 


Chief,  Professional  Service  (CPS)  Chairman 

PisK  Manager  Member 

Nursing  QA  Coordinator  Member 

Chief,  Inpatient  Care  Branch  Member 

Administrative  Resident  Member 

Secret-Try  to  the  CPS  Recorder 


A-  1 
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ANNEX  B 


( 


DEPARTMENT  OF  THE  ARMY 
Headquarters,  US  Army  Medical  Department  Activity 
Fort  Beivoir,  Virginia  2206C 

HSXA-FP  1  December  19S1 

Quality  Assurance  Program  for  the  Department  of  Family  Practice 

1.  Purpose.  To  establish  guidelines  for  reviewing  and  evaluating  the  quality  and 
appropriatenes'  of  inpatient  and  outpatient  services  within  the  department. 

2.  Scope.  Family  Practice  Inpatient  Services,  Family  Practice  Clinic,  DeWitt  Army 
Community  Hospital,  Fort  Beivoir,  Virginia. 

3.  Responsibility.  It  is  the  responsibility  of  the  Chief,  Department  of  Family  Practice, 
through  the  Family  Practice  Clinic  Director  and  the  Inpatient  Faculty  Coordinator  to 
conduct  a  review  and  evaluation  of  the  quality  and  appropriateness  of  the  inpatient  and 
outpatient  services  given  within  the  department  on  a  monthly  basis.  This  will  be 
accomplished  by  the  auditing  of  patient  medical  records  by  pre-established  criteria. 

4.  General.  The  criteria  to  be  utilized  in  the  review  will  be  of  four  types  or  categories. 

a.  Ongoing  daily  usage  of  Inclosure  1  titled  "Medical  Record  Audit"  examining  the 
resident  physicians'  capability  in  his/her  ongoing  medical  care  of  patients.  This  will 
include  the  thoroughness  of  the  record,  the  analytical  sense,  the  reliability  and  the 
efficiency  of  the  care  delivered.  This  form  will  be  utilized  to  evaluate  the  ongoing, 
overall  continuity  and  quality  of  patient  care  rendered  by  the  resident  physician. 

b.  Quarterly  audits  by  disease  category;  matching  residency  physicians  to  disease 
category  and  utilizing  the  Family  Practice  Computer  Management  System  in  identifying 
patient  category  type.  Audits  planned  for  calendar  year  1982-83  will  include  "diabetes" 
and  "hypertension"  and  will  match  resident  physician  to  these  categories  (see  Inclosure  2 
and  3). 


c.  Monthly  audits  of  pre-selected  patient  types  and  disease  categories  for  all 
physicians  (staff  and  residents)  preselected  by  the  department.  These  records  will  be 
audited  by  pre-selected  criteria  on  a  daily  or  weekly  basis  by  staff  physicians. 

d.  Monthly  audits  of  completed  inpatient  records  cf  patients  hospitalized  on  the 
Family  Practice  Inpatient  Services.  These  will  include  medical,  pediatric,  obstetrical  ar  d 
gynecologic  patient  categories.  Audits  will  be  conducted  once  monthly  at  the  Patient 
Care  Auditing/Quality  Assurance  Departmental  Meeting.  Records  will  be  reviewed  by 
criteria  lisied  in  Inclosure  4  and  charts/records  reviewed  will  be  coordinated  through  the 
Patient  Administration  Division,  DeWitt  Army  Community  Hospital  by  the  Inpatient  .Staff 
Coordinator. 

5.  Reporting.  Reporting  of  all  audit  results  of  all  categories  will  be  the  responsibility  of 
the  Chief,  Department  of  Family  Practice.  Results  will  be  report'-d  to  the  Patient  Care 
Auditing/Utilization  Committee  and  to  the  Quality  Assurance  Co.nmittee  on  a  monthly 
basis. 


(>.  I'roblem  Areas.  Problems  identified  in  the  i;hove  described  audits  will  be  so  recorded 
' ifi!i  nr,..;  tl'e  "O'lality  Assurance  Problem  Worksb^er"  (It\f:losure  s'.  Problems  uncovered, 
■"'■ms  .-■ouosed  .uiH  underraken,  .i.ul  the  resup;  rf.’-u'jdi vil!  h.*  r-'porte'.l  to  '.he 
iiosp!  ai  '.j'lality  Assurance  Comrnictee  with  this  lorm. 


[5- 1 


William  1.  Meinert 
LTC,  MC 

( .ni  .’f ,  ii'  .if  r  irriii •/  l-'ractice 
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.  DEPARTHFNT  OF  THE  ARMY 
DeWItt  Army  Community  Hospital 
..  Family  Practice  Center 

Fort  Belvoir,  Virginia  22060 

*  '0  * 

MEDICAL  RECORD  AUDIT  .  •  ■  • 

Patient's  Name:  _  '  _  Date:’  _ ] _ 

*  *  »  * 
Physician's  Mame^  _ .  _ 

Auditor's  Name:  _ 

Is  chart  legible:  _ Yes  _ No 

1.  Thoroughness: 

YES  NO 

a.  Complete  Data  Base  _  _ 

b.  Problem  list  complete  and  up-to-date  ^  _ 

c.  Plan  written  for  each  significant  problem  _  _ 

d.  Patient  profile  in  chart  _  _ 

e.  Medication  list  complete  and  up-to-date  _  _ 

f.  Overall  rating  of  thoroughness  of  record  ‘ 

_ Excellent  _ Satisfactory _ Borderline _ Unacceptable 

2.  Analytical  Sense; 

a.  Clear,  cogical  treatment  plan  of  acceptable  _  _ 

quality  for  each  problem 

b.  Proper  consultations  for  problems  _  _ 

c.  Is  each  problem  supported  by  adequate  data,  _  _ 

and  the  need  for  further  data  recognized 

d.  Abnormal  findings  noted  in  chart. (explained)  _  _ 

e.  Overall  Rating; 

Excellent  Satisfactory  _ Borderline  _ Unacceptable 


Inolosure  1  to  ANNEX  B 
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3.  Rel  labiHty; 

■.a.  •  .Wer,e  problM  plans.  Implemented.  ... 

b.  Were  additional  tests  and  procedures  indicated 
actually  performed 

cl  Overall  Rating: 


_ Excellent  _ Satisfactory  _ Dorderline 

4 .  Efficiency; 

a.  Were  paramedical  personnel  utilized,  if  necessary 

b.  Do  flow  sheets  exisif  if  necessary  to  deal  with 
complicated,  inter-related  problems 

c.  Did  physician  time  spent  seem  appropriate 
for  problem  stated 

d.  Were  "inappropriate"  or  "unnecessary"  lab 
or  x-ray  studies  performed 


Rorderl ine 


Unacceptable 


e.  Overall  Rating: 
E.<cenent 


Satisfactory 


Dordorl ine 


Unacceptable 


1  to  Afl.'IFX  B 
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1 


( 

DIABETIC  CHART  AUDIT 


Patient: 


Chart  #  _ 

Physician: 


1.  Problem  List 

2.  Medication  List 

3.  Documentation 

a.  Ophthalmology  consul, t 

b.  Dodiatri  co.jsult  * 

c.  Instruction  in  insulin  usage  or 
oral  hypoglycemics  if  given  * 

d.  Dietary  consult  * 

*  or  documentation  of  be.ng  performed  by 
primary  physician 

4.  f’ol low-up  visit  ever  2-3  months  if  on 
insulin  or  hypoglycemics;  every  6-12 
months  if  diet  controlled 

5.  Basic  laboratory  data:  Renal  function 
test,  lytes,  CBC,  urine,  urine  culture 

6.  Recurrent  laboratory  data:  PBS  (lower 
than  200) ,  urine  S/A 

V.  p.t;.!  Fundus,  BP,  C.V.,  fjl<in  Peripheral 
Sensation,  DTR 


c 


Overall  evaluation  Acceptable  J  Un  JCeept  .abl  i.'  ( 

Commen  t.'i : 


.  ! '  M  1  <-  i  f'.  '  '/a  Lc  i  in  : 


.'ll)  i'cTin 
18  D'JC  HQ 

Tnclo-iUre  2  i.o  ANNE^X  B  B-^! 
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( 

• 

MKDtCAL  RECORDS 

■ 

. 

, 

U’DTT— HVPERTEMS  ION 

• 

''.T  (■  i  ('nl; 

Date 

Rw,  i  'll  rc'.'iirity  ~ 

Physician 

Evaluator 

Choc’/.  1  •;  c(;r.i|).lotf! 

Check  if  complete 

rroblon  List 

Laboratory  and  Consultation 

ModiCiHLiona  Recorded 

_  Ophthalmoloqy  consult 

nynptomatoloyy  checklist 

_  CBC 

Physical  lixam 

_  Uh  c  CSS 

_  Ophthairroscope  exam  once/year 

_ _  Electrolytes  Na,  K,  Cl,  CO^ 

_ eatd iovawcMlar !  heart  rate,  rhythm, 

_  Ka sting  PMA-i.2 

(„ 

nurnur,  peripheral,  pulses,  presence/ 

_ Scrum  creati.nate 

absence  of  bruits  *■" 

_ Triglyce  rider, 

Porioii ii:  F.aboratory 

_ KKG 

_ r;L  'ctrolvtus:  q  A- 1,2  mos  q  2-1  wks _ CXR 

p  start  or  crianqe  or  diuretic 

_  2d  tour  l^riDury  r;rc -it  Inine 

I'h-'d:  '1  ■/'•■■•ir  '  u'  pr.-i  (7  py'.s  of  ri'.p 

if  abn,  re  rum  r  rcat ;  ri  ine 

(irir  Ac  i  1:  <i  2-3  wkn  o  start  or 

protein  if  .Lri,  '  A  {hx  of 

■•.'h.iiiqe  of  r.X 

renal  dr,,  protein  '•r  '(nc's  in  urines 

'"t(ir;r : 

_ 17  OH  S  17  K.S  _  i"  ('u  filing's. 

sin-nfi  5  aymptons 

VMA  ; ;oriMir.:il  hypn- 

'  ■'  'll- '  •i.t.'-,  : 

1 '  u  :  <-iri ,  ■'iu.dd.  ,  •i.h.'  .itaia,  d.a- 

••■yp;  rt I.  .1  Vc-i.iru  oi  1 

• 

IncloiiirP  3  In  /IfPIFX  R 

^  ■  r-,-  ■  '  R-S 

a  r!’.''r  i.  ,  1 it:i ,  :i,ii  ror.iiis  it 

ki'li'.i'Y  si/.r.  1  -  il 

;,*■  Hi  '  o  i '  I  1  • 
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OBSTETnicM.  rATist;?  crng  audit 


Dat« _ _ 

Chaxt  9  _ 

•Auditing.  Physician 


‘  COMPLETC 

» 

.r. 

‘  rticb;rp’iETB‘' 

1) 

Patient  ID  Dat9 

• 

•  1 

2) 

EDC,  or  corrected  EDC 

recorded  in  chart 

- 

'w 

3)  • 

Appropriate  data  for  each  visit 
recorded  (wt«  BP,  urine,  etc) 

*•  «. 

-r 

• 

4) 

La.b  Data  on  chart  •> 

Type,  Rh,  (let.  Hob,  PAP.  smear. 
Serology  .  . 

- 

« 

5) 

Review  of  Systems  Analysis  . 

• 

6) 

Past  Medical  History  and  Family 
History 

• 

7) 

Previous  obstetrical  record 

6) 

Complete  P.E. 

9) 

Pelvic  Exam  with  Obstetrical 
Prognosis 

, 

10) 

Chart  legible  .  . 

YES 

NO 

ComentB: 

' 

t 

e 

•* 

» 

» 

fivnrall;  .Acccptiiljlo 

Unacceptable 

iiiclosure  4  to  ANNEX  B 
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.  Problem  Mo. 


QUALITY  ASSURANCE  PROGRAM 
PROBLEM  ASSESSMENT  WORKSHEET 


•Date 


SECTION  1  -  IDENTIFICATION 
JL.  Statement  of  Problem;.  .  ^ 

2.  Source  of  Data;  '  •  • 


3.  Committee/Office/Indivldual  Identifying  Problem; 


SECTION  U  -  ASSESSMENT  Date 

1.  ^Identify  Applicable  Criteria^ 

2.  Feasible  Resolutions: 

■  t,v._  -*•  •  • 

3.  Recommended  Resolution; 

4.  Resources  Required; 


SECTION  in  -  EXECUTIVE  REVIEW  Date 


1.  Action  Taken; 


2.  Priority; _ Immediate  -  Resolve  within  30  days  -  review  monthly. 

_ _  Delayed  -  Resolve  within  6  months  -  review  monthly. 

_ Long  Range  -  Resolve  within  5  years  -  review  annually. 

_  Deferred  -  Resolution  not  feasible  with  current  resources  - 

'  review  annually. 


Inclnsure  R  to  ANNEX  B 
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SECTION  IV  -  IN  PROGRESS  REVIEWS 


1.  Status: 


2.  Status: 


3.  Status: 


•**  *•  *.*  ‘rf*  *  .  •  •  ' 

r  .‘u*. .  ^  ■ 

Date _ 

Date 


*.•  * .  * «  1. -5 


4.  Status: 


'J.  Status: 


Date 


Statement  of  Resolution: 


SECTION  V  -  RESOLUTION 


SECTION  VI  -  FOLLpW-UP/REVIEW 


nclosur'?  5  to  AMl'tFX  B 
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ANNEX  C 


DEPARTMENT  OF  THE  ARMY 
HEADQUARTERS.  U.  S.  DEWITT  ARMY  HOSPITAL 
FORT  DELVOIR.  VIRGINIA  22060 


16  December  1981 

Minutes  o£  the  Department  of  Family  Practice  Patient  Care  Auditing 
and  Quality  Assurance  Committee  Meetings 


Chairman 

Medical  Cure  Evaluation  &  Quality  Assurance 
DeWitt  Army  Community  Hospital 
Fort  Belvoir,  Virginia  22060 


1.  The  meetings  were  held  on  9  December  1951  aL  1230  hours  in  the  Main 

Conference  Room. 

2 .  Members  Present: 

CPT  John  H.  Black,  Chairman,  Patient  Care  Auditing  Committee 
Lie  William  J.  Meinerj:,  Chairman,  Quality  Assurance  Comnittee- 
Staff  Members;  ' 

Cl’T  Robert  Campbell 
CPT  William  McCarberg 
CPT' Mark  Hillard 
Resident  Members: 

CPT  Steve  Daugherty,  1st  year 
Cl’T  Janet  Spitzer,  Ist  year 
CPT  Steran  Reissman,  1st  year 
CPT  Laurence  Sharp,  1st  year 
CPT  Neal  Daillargeon,  2nd  year 
CPT  Mark  Seckerman,  2nd  year 
CPT  Eric  Brevner,  2nd  year 
CPT  Douglas  Cambier,  2nd  year 
CPT  John  Reasoner,  2nd  year 
CPT  John  Alves,  3rd  year 
CPT  Gerald  Dc  Tata,  3rd  year 
CPT  John  Pascal,  3rd  year 
CPT  Douglas  Phillip,  3rd  year 
M':mbars  B!:<cused  or  Absent: 

Major  John  Pogarty,  St.itE 
M-i'ior  R.  B.  ;itith,  Staff 
Ci''!'  tns-.'pti  i'lr.'sllarria ,  St.iff 
■::T'  sob-'c*:  Ir.l  ir 

tL\J  Thoma-j  Ely,  2rfl  ye.jr 
CIT  Wayne  .Jonas,  1st  ye.ir 
CPT  Jam'll!  McCliec,  1st  year 


SUBJECT; 


TO: 


C-1 
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HSXA-FP 

SUBJECT:'  Minutes  of  the  Department  of  Family  Practice  Patient  Care  Auditing 
and  Quality  Assurance  Committee  Meetings 

з.  Dusiness : 

None.  This  is  the  first  meeting  held.  Family  Practice  Inpatient  Service 
was  established  19  October  19^1. 

A.  New  Busines.s-“Chart  Review. 

a.  Reviewed  25  completed  inpatient  records  to  include  obstetrical,  gynecologic, 
medicine  and  pediatric  type  admissions.  The  following  deficiencies  were  noted  in 
these  records. 

(1)  Discussed  the  chart  of  a  45  year  old  WM  admitted  to  the  ICU  with  the 
diagnosis  of  shortness  of  breath,  wheezing  and  possible  pulmonary  embolus.  A 
deficiency  existed  in  the  record  in  that  a  specialized  procedure  was  not  coded 

on  the  cover  sheet,  "VQ  scanning'’,  and  the  diagnosis  of  "Medical  observation  for 
possible  pulmonary  .embolus ,  suspected,  not  proven"  was  not  listed  on  the  cover 
sheet.  Record  returned  to  PAD  for  additional  coding. 

(2)  Discussed  the  chart  of  a  2  y/o  WM  whose  parent  removed  the  child 
from  the  hospital  against  medical  advice  for  the  problem  of  wheezing.  No. mention 
is  made  of  this  on  the  cover , sheet— ‘returned  to  PAD  for  additional  coding. 

(3)  Discussed  the  record  of  a  1  y/o  BM,  admitted  with  potential  child 

neglect.  No  discharge  instruction  sheet  could  be  found  in  the  record.  This  was 

considered  a  major  deficiency  in  view  of  the  CPMCT  and  medico-legal  aspects  of 
the  case.  Chart  was  returned  to  the  physician  for  appropriate  notation  as  to 
disposition  and  followup. 

(4)  Dijcussad  the  record  af  a  25  y/o  BF,  admitted  to  the  ICO  with  aschma. 

No  mention  was  made  in  the  chart  of  the  results  of  several  blood  gases  dra'vn 
during  the  admission.  The  necessity  of  comment  by  the  physician  who  orders  lab, 
x-ray  tests  in  the  progress  notes  was  emphasized. 

(5)  Discussed  the  record  of  a  28  y/o  WF  admitted  for  an  incomplete 
abortion  who  underwent  an  elective  D&C.  Mo  tissue  pathology  report  was  in  the 
chart  after  1  month.  This  was  considered  inappropriate  and  the  chart  was  returned 
to  PAD  for  filing  of  the  tis.s  le  result. 

(6)  Di.scussed  the  record  of  a  61  y/o  WM  admitted  to  the  CCU  on  a  "R/O  MI 

protocol".  No  mention  is  made  of  the  results  of  a  CXR  done  on  admission.  Returned 

i.o  physician  for  correction  or  addendum  to  the  record. 

(/)  Discussed  tha  chart  o!;  a  48  y/o  admitted  to  TCU  './ith  asthma. 

:'.o  •■.enti'jn  ot  .i  C.'<R  done  on  .a.imlsji'.in. 

(8)  Discussed  the  chart  of  a  24  y/o  WF,  postpartum,  augmented  './ith 
pitocen  after  5  hours  of  SROM.  There  was  no  mention  as  to  th.-i  indications  for 
augmencition  or  whether  a  st.itf  0J3-CYN  person  was  consulted  /ogurding  th.e  drug 

и. s.age.  Chart  returned  for  addendum  to  notations. 

•  C-2 
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HSXA-FF 

SUBJECT:  Minutes  of  the  Department  of  Family  Practice  Patient  Care  Auditing 
'  and  Quality  Assurance  Committee  Meetings 

b.  Current  Inpatient  Chart  Review:  Census  on  the  Service  numbered  four  at 
the  time  of  the  audit.  All  charts  had  been  reviewed  and  various  deficiencies 
were  corrected  at  the  time  of  the  review  by  the  physician  in  charge  of  the 
patient's  care. 

c.  There  were  no  recorded  deaths  in  the  Family  Practice  Inpatient  Service 
since  19  October  1981. 

d.  Complications:  No  introgenic  complications  could  be  found  or  were  re¬ 
corded  in  patient  care  during  the  review. 

e.  Outpatient  Chart  Review:  Formal  Outpatient  Chart  Review  has  been  in 
effect  within  the  Family  Practice  Clinic  as  of  1  December  1981.  The  audits  will 
follow  the  format  illustrated  in  the  SOP  titled  "Quality  Assurance  Program  for 
the  Dept  of  Family  Practice",  dated  December  1981  (Incl  ;?1).  Audits  planned 
for  December  will  utilize  the  "Medical  Record  Audit"  daily  (Incl  '^2)  on  selected 
Resident  charts.  In  addition,  a  generic  audit  will  be  conducted  on  all  the 
Family  Practice  obstetrical  records  utilizing  Incl  3 ,  "Obstet«rical  Patient 
Care  Audit."  Results  of  all  these  audits  and  statistics  gathered  will  be  re¬ 
ported  in  the  January  minutes  of  this  Committee 


a.  The  entire  QA  Program  of  the  Department  was  explained  and  clarified  to 
members  of  the  department,  as  well  as  the  utilization  of  the  Problem  Assessment 
Worksheet. 

b.  The  first  QA  Problem  identified  from  the  Inpatient  Records  Audit  was  the 
high  percentage  of  charts  (302)  which  were  identified  as  deficient  because  of 
the  physician's  lack  of  documentation  regarding  pertinent  lab,  :<-ray  and  other 
data.  The  feeling  of  the  majority  of  the  members  :/as  that  "if  a  lab  test  is 
important  enough  to  be  ordered,  some  mention  of  its  results  should  be  made  in 
the  progress  notes".  This  statement  was  e:<panded  to  include  other  facets  of 
the  patient's  care — to  include  the  results  of  consults,  physical  therapy  and 
respiratory  therapy.  See  Incl  f?4  for  recommendations. 


6.  Meeting  adjourned  at  1335  hours. 


WILLIAM  J.  MEINERT,  M.D. 

LTC,  'AC 

Chairman,  QualL-:/  Assurance.  CommicCee 
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ANNEX  D 


QUALITY  ASSURANCE  PROGRAM 
PROBLEM  ASSESSMENT  WORKSHEET 


SECTION  I- IDENTIFICATION 

A.  Statement  of  Problems: 


Date 


B.  Source  of  Data: 

C.  Committee/Office/ Individual  Identifying  Problem: 

D.  Recommended  Individual/Conmittee/Activify  to  investigate  Problem: 


SECTION  1 1 -ASSESSMENT  Date 


A.  Identify  i^licable  Criteria! 


B.  Feasible  Resolutions: 


C.  Recomooended  Resolutions: 


D.  Resources  Required; 


SECTION  Ill-Executive  Review  Date 


A.  Action  Taken: 


B.  Priority:  _ Inmediate-Resolve  within  30  days-review  monthly. 

_ Delayed-Resolve  within  6  months- review  monthly. 

_ ~Long  Range-Resolve  within  5  year.s- review  annually. 

_ T)eferred-Resolution  not  feasible  with  current 

resoitrces-review  nnnuaily. 


^^EDUAC  (CSD)  FORM  522 
1  April  1982 
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SECTION  IV- IN- PROGRESS  REVIEWS 

A.  Status:  Date 

t  “ 

B.  Status:  Date_ 

C.  Status:  •  Date_ 

D.  Status:  Date_ 

E.  Status:  Date 

'  ■■  SECTION  V-RESOLDTION 

Statement  of  Resolution:  Date_ 

SECTION  VI -FOLLOW-UP/REVIEW 

Date 


'J-Z 
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ANNEX  E 


I  COMMITTEES  MONITORED  BY  QA  COORDINATING  COMMITTEE 

ACCREDITATION 

AMBULATORY  PATIENT  CARE 

EMERGENCY  MEDICAL  SERVICES 

BLOOD  TRANSFUSION  tc  TISSUE 

CANCER 

CLINICAL  INVESTIGATION/HUMAN  USE 

CREDENTIALS  COMMITTEE 

INFECTION  CONTROL 

ANTIBIOTIC  UTILIZATION 

MEDICAL  CARE  EVALUATION 

CARDIO-PULMONARY  RESUSCITATION 
CRITICAL  CARE 
DISCHARGE  PLANNING 

MORBIDITY  AND  MORTAUTY 

Sm'- 

RABIES  CONTROL  BOARD 
RISK  MANAGEMENT 
SAFETY  AND  FIRE  PREVENTION 
THERAPEUTIC  AGENTS  BOARD 
TUMOR  BOARD 

II.  ACTIVITIES/SERVICES  MONITORED  BY  QA  CORDINATING  COMMITTEE 
ANESTHESIA 

CHN  (HOME  CARE  EVALUATION) 

DEPARTMENTAL  QUARTERLY  QA  MEETINGS 

DIETETICS 

DON  QA  PROGRAM 

FORT  A.  P.  HILL  HEALTH  CLINIC 

PATHOLOGY 

PATIENT  REPRESENTATIVE  (MONTHLY  REPORTS) 

PHARMACY 

t’HY  ^1'.:AL  i'HERAPY 

RADIOLOGY 

RESPIRATORY  THERAPY 
SOCIAL  WORK 

VINT  HILL  FARMS  STATION  HEALTH  CLINIC 
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ANNEX  F 


INVENTORr  OF  RELATED 

QUALITY  ASSESSMENT  &  CONTROL  REQUIREMENTS* 


STANDARD 

FREQUENCY 

SCOPE/FXUS 

'CONTENTS 

I.  An«5tti«tla 

Quarterly 

.  Monitoring  to  reflect 
the  scope  of  tiospltal's 
anesthesia  services 

.  Include  review  of  al 1 
categories  of  anesthe¬ 
sia  personnel 
.  Not  llmltod  to  mor¬ 
bid  Ity/mor  fa  1  Ity  rovlew 
.  Representative  sample 

.  Should  bo  part  of  overall 
hospital  QA  program 
.  Medical  record  rciqulre- 
irwints  specified  (p.O) 

.  Involve  use  of  preostab- 
lished  criteria 

2.  Dlatatlc 

Annual  1 y 

.  Review  nutritional  care 
of  Inpatients,  out¬ 
patients,  home  core, 
and  outside  contracted 
services,  as  appro¬ 
priate 

,  Representative  sample 
•  Quality  control  mocha- 
n 1  sms  for  spec  1 f 1 nd 
procosses  such  as 
nutritional  assessment, 
dietary  Instruction, 
etc. 

.  Should  be  part  of  overall 
liospltal  QA  program 

.  Shall  USB  riv->dic‘ol  record 
and  preastab 1 1  shed 
cfl ter  I  a 

•  Review  shall  Include  con¬ 
tributions  from  modicel, 
nursing,  and  Jlwtefic 
staffs 

•  Medical  rocord  roqu  re- 
raents  sped  f  led  (p.i  T) 

3.  Emergancy 

Hon  th  1  y 
(Recom- 

tnendad 

more  fre¬ 
quently  It 
rapid  turn¬ 
over  of 
physician 
staff  1 ng) 

,  Particular  uttontlon  to 
DOAs,  deaths  within  the 
ED  and  deaths  within 

24  hours  of  admission 

from  the  EO 

,  Reprosentotlvo  somple 
,  Quality  control  mecha¬ 
nisms  for  specified 
processes  such  as  re¬ 
call  mechanisms,  modi- 
col  record  review,  ofc. 

.  Shall  uso  medical  record 
and  press  tab  1 1  shed 
cr 1  ter  1 » 

.  Medical  rocord  roqulre- 
ments  sped  f  1  ed 
!pp.32,33) 

*Fwcorpt5  from  Joint  Comm  I  5  Ion  on  Accrod  I  tot  Ion  ot  Hojp  I  tfl  I  i,  Accrod  I  t-it  I  on  M-^nual  for 
Ho-jp  I  tnl  s,  IISI  Edition. 


_ _ _ _ _ y 
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STANOAmi 

FREOUENCY 

SCOPE/FOCUS 

CONTENTS 

4.'  Functional 
Safety  and 
Sanitation 

Continuous 

program 

effort, 

monthly 

committee 

nxiatings 

.  Comprehensive  hospital' 
wide  program 

•  Review  to  Include 
patients,  hospital 
staf*  and  visitors 

•  Pol Icy/proceduro 
development,  coordi¬ 
nation,  review 

•  Incident  reporting 
system 

.  Liaison  with  Infection 

control 

,  Produce  sate  character¬ 
istics  and  practices; 
ol  Imirrata  or  reduce 
hazards  to  the  extent 
twsnihio 

.  Include  review  of  oil 
pertinent  rocords  and 
reports 

.  Methods  for  measuring 
of  safety  program  and 
analysis  to  determine 
effectiveness 

9i  Oovarnlng 

Body  (GB) 

Continuous 

,  Assure  a  comprehanslve 
hospital  wide  QA  program 
.  Credential  1 Ing  nnd 
privileges  delineation 
oystems/po  tides 

.  Through  CEO,  ensure  that 
administrative  assistance 
riocos'iory  to  facilitate 
objective  analysis  of 
qua  1 1 ty  care 
•  G6  should  specify  the 
nature  and  frequency  of 
soUniBslon  of  reports 
required  hy  medlcol  staff 

QA  activities 

6»  Hom  Cara 

.  •  Annual 
Program 
Evaluation 
.  Quarterly 
review  of 

medical 

records 

•  Review  to  Include  direct 
and  outside  contracted 
services,  If  usud 
.  Both  active  and  closed 
COSO  medical  records 

review 

.  Roprasentativo  samp  la 
.  Caso  plan  review  of 
least  ovary  60  days 

,  Should  be  part  of  overall 
hospital  QA  program 
,  Muir Idl scipl 1  nary  advisory 
ccfnmltteo  must  Include 
( 1 )  physician,  ( 1 )  RN  and 
other  professionals  in¬ 
volved  In  program 
.  Evoluato  of foctivenoss  of 
object  Ivus 
.  Review  to  Include 
occessibl  1 1  fy,  timeliness, 
ond  need  of  sorvicos 
.  Mod  leal  record  roqulro- 
monts  !ineclM:)d  (p.6l) 

F-P. 
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STANDARD 


FREQUENCY 


SCOPE/FOCUS 


CONTENTS 


■/.  Hospital 

Spon sored 

Ambulatory 

Care 

.  Biannual ly 
.  Rocon- 

mended 

more  fre¬ 
quently  If 
organ Ized 
by  service, 
have  out¬ 
reach  pro¬ 
grams,  er 
rapid 
physician 
turnover 

•  Review  to  Include 
entire  scope  of 
services  and  outside 
contracted  services, 

1 f  used 

.  Representative  sample 

.  May  be  ,'..'rt  of  clinical 
servlce/department  review 
mechanisms 

.  Shall  use  medical  record 
and  proestabi Ished 
criteria 

.  Medical  record  roqulro- 
rient  specified  (p>fi8) 

8.  Intoctlon 

fiintrol 

•  Bimonthly 
cofiwni  ttee 
meetings 

•  Continuous 

data  col¬ 
lections, 
surveil¬ 
lance  and 
policy' 
review 

.  Hospital  wide 
•  Review  to  Include  al 1 
patients  and  personnel 

•  Standard  criteria  for 
Identifying  and  reporting 
Infections 

•  Determine  Infection  rates 
.  System  for  data  collec¬ 
tion,  reporting,  anti¬ 
biotic  review  and 
evaluation  and  follow-up 
action 

.  (Inntlmjous  review  and 
evaluation  of  nil  hospital 
aseptic.  Isolation  and 
sanitation  tachniquas 
.  Raqulrad  participation  by 
mad  leal  staff,  nursing, 
jidmtnl strati 50,  and  when 
available,  microbiology 
section  uf  lab 
.  Medical  record  raqulre- 
fnunt  spud  fled  (p.74) 

9«  Medical 

Staff 

(pp.IOS-IOBJ 

U.  Spncl'il 

Pa  float 

(Utrii  Evaliia- 

f  1  ‘ti  f.'l  f  far- 

a  As  Indl- 

to 

■Tri'-.o-i--. 

M..,] 

■ 

*  Moprus'intoMvH  Ssimple 

.  Coniluct  peel  tic  studios, 
ar,  Inrllcifod  using  pro- 
nstabi 1  shed  criteria 

r 


STANOARD 

FREgUENCY 

SCOPE/FOCUS 

CONTENTS 

f.  Anti¬ 
biotic 

Usage 

Continuous 

Assessment 

.  Should  Include  review 
of  inpatients,  ambula¬ 
tory  and  ontergenoy 
patients 

.  Representative  sample 

.  Should  Include  proptiy lac¬ 
tic  Hfid  thorapoutlc  use 
for  all  categories  of 
pfltlonts 

,  Cr i tor  Ion-based  review  In 
problem  iirons 

.  Clinical  rnvlow  as  well  nr. 
fttatl  sMcal/provrtlonco 
studies 

.  Control  of  usngo  based 
on  assessment  studies 

g.  Other  - 

patient 

related 

profea- 

■lonal 

activities 

As  Indi¬ 
cated  by 
specific 
review 
activity 

•  As  Indicated  by  1he 
specific  review  activi¬ 
ties 

.  Reprcaontar  1  ve  sampU 

.  Par t Ic  1  fiu Mon  In  hospital- 
wide  act  iv  1  ties  Including 
planning,  safety,  etc. 

.  fatlant  care  eve  1  nor  Ion  iii 
ED,  OPO,  home  care 
.  Role  In  care  of  wnotlon- 
ul  1  y  III,  al coliu  1 1  cs, 
drug  abusers  clarified 

Not«<  Oth«r  rsqulrad  mdical  staff  functions  Includa  utilization  ravlaw,  (sao  p.22), 

monitoring  of  cl  Inlc  t-pol'leles  and  procedures,  fxirtaMty  po/low,  otc.  In  addi¬ 
tion  (PHdlcal  staff  quality  control  Includes  use  of  assossmenl’  findings  for 
credentials,  privileges  delineation  and  continuing  uducatloo  purposus  oitong 
other  corrective  action  optlohs. 


10.  Nuclear 
Hedlclne 

.  Unspeci¬ 
fied  evalu¬ 
ation 

act  1 vl 1 1  os 

.  Continuous 
safety 
siirvel  1- 

lance 

.  Rovlow  and  uvaluafa 
quality,  safety  and 
appropriateness  of 
service 

•  Documented  review  and 
evaluation  of  tc'llcles/ 
procedures  and  commltteo 
activities 

.  Modicnl  record  roqulro- 
iront  sped  tied  (p.lM) 

lie  Nursing 

(Quarterly 

.  Representative  sample 

.  Should  be  Intwjratod  when 
possible  with  other 
hospital  iictivltin;. 

.  Dnsod  on  written  criteria 
.  Include  nursing  rare 
personnel  who  iro  not 

’  j't.i '  'ill  'Ip  1  r/'i-'i 

.  i.lr  i  fly  'f  /nmods  ■‘■'ll  r") 
ii'.od  f  jr  rov  1 'iw/i'V-u  1 'Id  t  Inn 
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STAND AHO 


b.  TIssu* 
(surgical 

cat*) 

Rav  I  aw 


FREOUENCr 


Cl  Pharmacy 
and  Thara- 
peiitlcs 


di  Mad  I  cal 
Racord 


Oi  Blood 
Utilization 


SCOPE/FOCUS 


Include  Inpatients  and 
outpatients 

Review  to  Include  cases 
whuru  spec  I  mens  wore 
and  war*  not  recovered 
Review  all  cases  with 
major  preoparatl vb/ 
postoperative  dlscrop- 
ancles 


I  Development  and  survell 
lance  of  pol  Ides  and 
practices,  Including 
drug  utl 1 Izatlon 
I  Ad  'Im  cr  avallcM* 
drugs,  formulary 
changes,  updating  for¬ 
mulary,  drug  reactions 
rovlew,  and  oxperlmen- 
tal  drug  use  approval 


Rovlaw  to  Include  In¬ 
patient,  liospitol- 
sponsored  ambulatory 
care,  ED  and  home  core 
records 

Ropresentatl ve  r.nmpla 


Review  to  Include  In¬ 
patient,  hospital- 
sponsored  ombulatory 
care,  ED  and  special 
care  patients 
Ropresantatl ve  samp  I o 


CONTENTS 


Review  shall  Include 
Indications  for  surgery 
May  use  screening 
mocnanlsms  with  pre- 
dotermlned  criteria 


In  cooperation  with 
pharmacist  stid  other 
disciplines  as  required 


Rovlew  for  timely  cc»np lo¬ 
tion,  ellnloji  perti¬ 
nence,  overal I  odequncy 
for  use  In  quality  assess¬ 
ment  activities,  and  os 
medico- legal  documents 
Required  nursing  and 
medical  record  staff 
participation 


Iday  be  performnd  through 
retrospective  patient  care 
evaluation,  medical  record 
review,  or  other  patlent- 
speclflc  review  mechanism 
Review  for  proper  utili¬ 
zation  ot  blood  trans¬ 
fusions 

Shal 1  rpvlow  whole  vs, 
compononf  hI'Xid  elements 
Sdril  I  rnvl'w  ill  actual 
ur  .'I  qjoct  ■Kl  rjactlniis 
SlKiuld  rovlaw  nmount 
roquostod,  used,  and 
wastage 


STANDAKO 

FREOUENCY 

SCCPE/FOCUS 

CONTENTS 

12.  f^tSology 
«nd  Itodl- 
cal  Labor¬ 
atory 

Sarvlcaa 

Unsp«cl  f  l«d 

.  Participation  In  hos¬ 
pital  QA  program 
•  tervicawlda  quality 
control  program  to 
assura  ral labi 1 Ity  of 
laboratory  data 

.  Director  of  Pathology  und 
medical  IcUoratory  assura 
departments'  par  tic  1- 
pat  Ion  In  ovoral  1  QA 
program 

13.  Hhanaacatt- 
tlcal 

Sarvlcaa 

Unspacl  f lad 

•  Include  dspartmantal/ 
sarvica/indl vidual 
prascribar  ravlav 
.  Raprasantativa  samp  la 
.  Intradapartmantal 
quality  control  strat- 
eglas  such  as  drug 
prof  Ha.  pc  Mel  as/ 
procaduras.  ate. 

.  Should  be  part  of  overal 1 
hospital  QA  program 
specific  to  drug  utili¬ 
zation  and  of  fact  Weness 
.  May  Include  determining 
usage  patterns  by  clinical 
departman  t/physicians 
.  Assist  In  eitnhilshing 
drug  use  criteria 

U.  (Radiology 

t 

aa. 

.ON  ’ 

Unspacl t lad 

.  Ravlav  to  Include 
Inpstlant.  outpatient, 
and  EO  sarvlcaa 

.  Review  anO  evaluate 
quality  and  oppropr la'lo- 
ness  of  services 
.  Medical  record  require- 
ments  sped  fled  (pp. DO- 
ISO) 

19.  Rahablll- 
tatlon 
fVojrams/ 
Sarvlcaa 
Including, 
aa  appi 1- 
cabla, 
any  apo¬ 
dal  Izad 
sarvlcaa 
prov 1  dad 
Including 
Pbyt 1 ca 1 
ri'urnoy , 

Occupa¬ 

tional 

Itinrapy, 

utn. 

Quarterly 

.  Ravlav  to  Include 
Inpatient,  outpatient 
and  EO  service* 

.  Reprosantativa  sample 

.  Systorantlc  review  ond 
evaluation  of  qiiall  ty  and 
nppropr 1 ateness 
,  Predetermined  criteria 
.  Purtlclpatlon  by  medical 
staff  ond  rehobi 1 1 tatlon 
personnel 

.  Medical  record  rcniulre- 
monts  specified  (pp,164  - 
IfiS) 
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STANDARD 


FREOUENCT 


SCOPE/FOCUS 


CONTENTS 


16.  Respiratory  Quarterly 
Cara 


Rev  I  aw  Includas  In- 
pattants.  outpatients, 
home  care  patients,  and 
outside  services.  It 
used 

Representative  sample 


.  Phys  Id  an-cll  rector 
respons Ibt  1 1  ty 

.  Should  bu  par formed  within 
overall  hospital  QA 
projjram 

.  Review  and  evaluate 
nuallty,  appropriateness, 
and  effectiveness 
.  Shal 1  use  medical  record 
and  preastabi Ishod 
criteria.  Including  Indi¬ 
cations  for  use, 
effectiveness  of  treat¬ 
ment,  and  adverse  effects 
requiring  d' rccnt I  nuance 
of  treatment 

.  Shall  Include  contribu¬ 
tions  of  medical  staff  and 
respiratory  care  services 
»  Particular  attention  to 
highly  utilized  services 
.  Medical  record  require¬ 
ments  specified  tpp,  ITS, 
176) 


Snrv I ces 


Review  Includes  In¬ 
patients,  outpatients, 
home  care  patients  and 
outside  services.  If 
used 

Representative  sample 


Should  be  performed  within 
the  overall  iKsspItal  QA 
program 

Review  and  evaluate 
quality,  appropriateness 
and  effectiveness 
Includas  all  catagorles  of 
patients 

Shn I  I  use  mod  I cn 1  record 
and  preastabi  I  shad 
cr I  tor  I  a 

(Indications  for  social 
work  Intervention) 
Particular  .ittontlon  to 
discharge  plannlnf|  and 
timallnoss  of  emoryency 
v)rv  Icos 

Miitji’il  •- irord  r'.!<|ijl  r*»- 
I'l'iM  t'  1  ',u‘iC  j  f  i  nI  (  j  .  1 60 ) 


STANDARD 


FREQUENCY 


SCOPE/FOCUS 


CONTENTS 


te.  Sp«ctal 

Qu»rt«ply 

.  Raprasantat 1 va  samp la 

.  Phys 1 c 1 an-d I roetor 

Oolt» 

tor  imiltl- 

tor  all  units 

rasponsibl 1 Ity 

purposo 

,  Should  ba  part  ot  ovarat 1 

purpos*  or 

unitsj 

. 

hospital  QA  program 

spaci fic- 

unspoci tiad 

.  Quality,  sataty  and  apprcr* 

purpoM) 

for 

priatsnass  sveluatad  on 

spaci tie 

regular  basts 

purpo&o 

.  Written  criteria  tor  ad- 

■ 

units 

mission  to  and  dtncharga 
from  special  care  units 

APPENDIX  D 

CORNEAL  ABRASION  STUDY 


TO;  MAJ  Thomas  Hoffer  iC/CJSA 
Dewitt  Anry  Hospital 
Ft.  Belvoir,  VA  22060 

FROM:  MAJ  James  Benvenuti  MJ/USA 
Dewitt  Anty  Hospital 
Ft.  Belvoir,  VA  22060 

DATE:  1  Deceirber  1981 

SUBJICT;  PPELIMINARy  Q/A  CKETEEOA  FOR  CHART  REVIEW  OF  OORNBAL  ABRASION; 
MINIMUM  DATA  TO  BE  INCLUDED  IN  RECORD 


1.  (If  patient  is  verbal) :  some  description  is  given  of  recent  onset 

of  eye  pain  or  feeling  a  "foreign  or  "something  in  the  eye"? 

+/“  photophobia;  itention  is  made  ofjLany/no  change  in  visual  acuity; 
and  some  mention  is  given  to  related  etiologies  such  as  "followed 
a-ooncussion  or  scratch  to  face"  or  "wearing  contact  lenses",  etc) 

2.  Objective  confirmation  of  corneal  abrasion  is  shown  by  stating 
either  one  of  the  following; 

_ a.  Observation  of  corneal  light  reflection  using  oblique  side 

moving  illumination  ("flashlight  test")  shews  abrasion 
(or  abrasion  ^adews  cast  upon  iris) ;  or 

_ b.  Sterile  fluorescein ,  strip  reveals  corneal  abrasion  vhich  was 

not  evident  on  "flashlight  test";  chart  mentiem  that 
greenish  speckled  pattern  is  not  dendritic  branching 
(which  would  suggest  Herpes  keratitis) . 


3.  Evaluation  using  binocular  magnification  and  lid  eversion  excludes 
foreign  bodies  remaining  and  excludes  penetrating  or  perforating 
injuries  into  eye. 


4. 


Itie  pertinent  normal  eye  findings  are  included,  such  as;  visual 
acuity,  PRERLA,  BOM  intact,  fundoscopic  exam  VJNL,  cornea 
^’otherwise  clear"  and  visual  fie].ds  hW,  to  gross  confrontation. 


5.  Pertinent  negatives  are  mentioned,  such  as: 

_ a.  No  corneal  anesthesia,  pigmentations,  diffuse  cloudiness 

or  radiations  into  sclerae.  ^  . 

_ b.  No  purulent  discharge  associated  with  eye  paip,t>/»«‘^^' ^  ' 


6.  Treatment  plan  is  specified:  including  firm  eye-patches  and  a  3-5 
day  course  of  antibiotic  ophthalmic  solution. 


7.  Follow-up  is  specified;  including  reappointirent  within  24-36  hcv.Ji's 
foe  reexamination. 

8.  Pollow-up  is  arranged  until  either  corrplete  resolution  of  the  problem 
or  referral  for  complications  such  as  infectious  keratitis. 


A, 
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TO: 

FROM: 

DATE:' 

SUBJECT; 


MAJ  Thomas  Hoffer,  MC/USA 
DeWitt  Army  Hospital 
Ft.  Belvoir,  VA  22060. 

MAJ  James  Benvenuti,  MC/USA 
DeWitt  Army  Hospital 
Ft.  Belvoir,  VA  22060 

7  January  1982 

REVISED  Q/A  AUDIT  OF  ETR  "CORNEAL  ABRASIONS" 


1. 


2  . 


Review  of  Emergency  Rpom  Log  for  the  past  six  months 
yielded  90  cases  listed  as  corneal  abrasion:  5  of  these 
cases  were  eliminated  because  other  diagnoses  were  listed 
on  the  record,  such  as  "conjunctivitis". 

Of  the  remaining  85  records,  32  were  available  in  our 
clinic  and  were  audited. 

Using  the  Hoffer  Corneal  Abrasion'  Criteria,  the  following 

deficiencies  were  noted: 

a:  12.5%  =  No  mechanism  of  injury  noted; 

b.  40.6%  =^.No  subjective  symptom  listed; 

c.  21.8%  '^'No  visual  acuity  noted; 

d.  46.87o  =  No  fluorescein  test  cited; 

e.  ,  0.0%  “  No  eye  inspection  noted; 

f.  9.3%  =  Diagnosis  not  given  as  "Corneal  Abrasion"; 

g.  65.6%  =  Treatment  Plan  did  not  list  topical  antibiotic; 

h.  50.0%  =  Treatment  Plan  did  not  list  pressure  patch; 

i.  ,34.37o  =  Follow-up  did  not  specify  return  within  24  h4-48 

I 

These ' deficiencies  do  not  necessarily  represent,  poor  quality 
of  care:  for  instance,  although  the  fluorescein  test  was 
not  cited,  it  probably  was  routinely  done  by  the  Emergency 
Room  staff.  It  is  also  notev'^orthy  that  the  criteria  were 
only  recently  developed  and  dJ.sseminated :  except  for  the 
recent  few  months,  the  sta.ff  had  no  guidelines  provided - 
Nevertheless,  providing  a  reminder  to  the  stafef  of  these 
criteria  might  improve  quality  assurance  at  this  hospital. 
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APPENDIX  E 

FOLLOW-UP  CORNEAL  ABRASION  STUDY 


TO;  COL  Jose  Ossorio,  MC/USA 
Dewitt  Army  Hospital 
Pt.  Belvoir,  VA  22060 

FROM;  MAJ  James  Benvenuti,  MC/USA 
DeWitt  Army  Hospital 
Ft.  Belvoir,  VA  22060 

DATE;  13  January  1982 

SUBJECT;  Q/A  ONGOING  AUDIT  OF  ETR  "CORNEAL  ABRASIONS" 


1.  On  7  January  1982,  an  audit  of  Emergency  Room  records 
for  the  past  six  months  yielded  32  available  records  of 
"Corneal  7d)rasion";  the  following  deficiencies  were  noted; 

a.  12.5%  ■  No  mechanism  of  injury  noted; 

b.  40.6%  “  No  subjective  symptom  listed; 

c.  21.8%=  No  visual  acuity  noted; 

d.  46.8%  =  No  fluorescein  test  cited; 

c.  9.3%  «  Diagnosis  not  given  as  •’Corneal  Abrasion"; 

f.  65.6%  =  Treatment  Plan  did  not  list  topical  antibiotics; 

g.  50.0%  »  Treatment  Plan  did  not  list  pressure  patch; 

h.  34.3%  =  Follow-up  did  not  specify  return  within  24~48  bzs 

1.  0%  =  No  eye  inspection  noted. 

2.  By  1  Decemberft,1981,  the  above  Hoffer  Criteria  had  been 
developed  and  disseminated  to  the  staff.  During  the 
following  month  of  December,  19  charts  of  patients  treated 
for  "Corneal  Abrasion"  were  collected  and  audited.  The 
following  deficiencies  were  noted; 

a.  10.5%  =  No  mechanism  of  injury  noted; 

b.  36.8%  =  No  subjective  symptom  listed; 

c.  36.8%  =  No  visual  acuity  noted; 

d.  36.8%  =  No  fluorescein  test  cited; 

e.  0%  =  Diagnosis  not  given  as  "Corneal  abrasion"; 

f.  10.5%  =  Treatment  Plan  did  not  list  topical  antibiotics; 

g.  21.0%  =  Treatment  plan  did  not  list  pressure  patch; 

h.  36.8%  =  Follow-up  did  not  specify  return  within  24-4S  hrs 

1*  0%  =  No  eye  Inspection  noted. 

3.  Using  the  Chi-Square  Test  for  analysis,  statisttbally 
significant  improvement  is  docrimented  for  the  following 
criteria; 

f.  Treatment  Plan  to  list  topical  antibiotic;  and 

g.  Treatment  Plan  to  list  pressure  patch. 

4.  Because  of  the  remaining  high  rate  of  deficiencies, 

a  re-publication  &  dissemination  of  the  Hoffer  Criteria 
for  Corneal  Abrasion  is  recommended  -  to  iricludc  all 
involved  staff. 


4 


APPENDIX  F 
SURVEY  DOCUMENT 


DIfl.a,  FACriJTlC 


APPENDIX  G 


CONCERNED  CARE  FORM 


ONCERNED  CaRE  CoMMENTS 

•Please  refer  to  back  for  Privacy  Act  Statement 

TO:  Patient  Representative  Office 

DeWitt  Army  Community  Hospital 
Fort  Belvoir,  Virginia  22060 

Let’s  Hear  /*bout_ _ 

- Compliments:  Staff  member  (military,  civilian  and  volunteers)  who  are  doing  an 

outstanding  job. 

- Suggestions:  An  idea  that  would  improve  our  care. 

- Problems;  Something  to  bring  to  our  attention. 


DATE: 


(PLEASE  PRINT) 

NAME: - - - -  Sponsor’s  Social  Security  Number: 

ADDRESS: _ _ _  . _ _  _ _ _  _ 

— _ _  Telephone: _ _ _ 

zip  code 


Mr;ni».\r  tc.sij.  ;|.|2 
I  .Inn  HI  iUi'\  I 
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APPENDIX  H 


PATIENT  REPRESENTATIVE  MONTHLY  REPORT 


Fqr  u<«  o(  thli  form,  tn«  AR  340'1S.  th«  proponent  flrjipcy  it  TAGO. 

HEFEnENCE  OR  OFFICE  SYMBOL  SUBJECT  ^  ~  " '  ' 

HSXA-CS  PRO  Activities  -  March  1982  . 

^°CDR,  MEDDAC  P.R.O.  5  April  1982  cmt  i 

1.  The  Patient  Representative  Office  activities  for  March  1982  are  presented  for  revie'. 

\  matrix  which  lists  the  problem  areas  by  clinic/service  is  attached.  (Incl.  1) 

2.  Analysl,?  of  encounters; 


JANUARY 

FEBRUARY 

MARCH 

Information/Direct ions 

391 

432 

498 

45% 

Followup  with  Patients 
Contact  with  Staff  or 

70 

78 

1?5 

11% 

Other  Agencies 

231 

226 

231 

21% 

Assistances 

8 

9 

2 

1% 

Complimisnts 

56 

74 

131 

12% 

Problems 

109 

73 

117 

10% 

TOTAL 

865 

892 

1104 

100% 

3.  The  P.R.O.  re.ce'i.’'Fd  nne  hundred  and  thirty’-ont  (131)  coiaplirafcnts  this  montht  Ward  AA  ( 
Ward  3B  (17),  Ward  AB  (12),  Family  Practice  (10),  ETR  (6),  AMIC  (5),  Urology  (5),  Surgery 
Orientation  (5),  Optha.lmology  (5), Surgery  (4),  Orthopedics  (3),  I.  &  D  (3),  OB/GYN  (3)  and 
Respiratory  Therapy  (3).  The  following  areas  received  2  compliments  each:  OR,  Recovery,  Fi 
Service,  ICU,  Internal  Medicine  and  Neurology.  Red  Cross,  Ward  3B,  A  &  D,  Anesthesiology, 
PRO,  Med.  Company,  Hounekeeplng,  PT,  Refill  Pharmacy,  GMO  Clinic,  Occupational  Health,  CCU, 
and  Cardiology  rece.lved  one  compllotMt  each. 

4.  CommctTb. 2'h( nil  i  b.r  r lx  (Incl.  1) 


CENTRAL  The  complaints  about  this  service  have  significantly  decreased  again  this 

APPOINTMENTS:  month.  It  is  interesting  to  note  the  number  of  complaints  regarding  the 
phoncii  ill  Family  Practice  and  in  Pediatrics. 

ETR/TRIAGE:  I  Poor  communications  resulted  in  at  least  12  of  these  complaints  thi.s  inont 

INPATIENT:  Three  patients  stated  that  the  staff  on  Ward  4B  are  doing  a  good  job,  bu( 

they  seem  terribly  overworked!! 

Mo  other  trends  v.'ere  noted  this  month. 


5.  C.'jse  of  the  month: 

ROB  LEM  I!  I',  An  11  y.c.  dependent  son  and  his  father  arrived  at  the  Orthopedic  Clinic  at 
approximately  0930  hours  on  a  Thursday.  They  supposedly  were  referred  by  Quantico,  but  the*, 
[h.id  no  appointment  and  no  referral.  PRO  11  LEM  II 2:  Orthopedics  referred  the  patient  to  iLMIC 
f'lr  referral  not  tninkin'-'  that  AMTC  doe,sn't  see  anyone  less  t'.ma  13  \-.o,  IrROBLEM  ;;'3;  A.'ll’: 


i'o'i  iacr  Icij  vM’.ere  lie 


,  Lven  a  'ijut  j.in..;"  referrai  to  Orthopedic.s . 


returned  to  0 rt hoped  1  c r,  where  he  was  told  that  ho  would  need  to  make  an  appointment 
throu  gh  CAS.  The  CAS  intercom  phones  were  out  of  order.  :  The  CAS  supervisor 

!wa,;i  makin;.;  appointments  in  person,  but  the  soonest  appointment  v,'as  for  one  month  in  advanc.:*. . 
■'lie  ]) at  Lent’s  Jather  felt  that  this  wa.s  unsatisfactory  so  he  returned  to  reillatrics  to  have 
t:..-.!  chatnyj  the  referral  from  "routine"  to  "TODAY".  He  then  returned  to  Orthopedics. 

this  time,  the  emergency  doctor  lu  Orthopedics  had  been  called  to  the  Emurg-.'.n 
Haora.  The  patient  and  his  dad  were  a.sked  to  wait,  but  they  did  not  wish  to  do  so.  They  I 


I  ORM 
(10 


2438 


•'HIVIOUU  LDI  riONS  WILL  Ur  USHD 


HSXA-CS 

PRO  Activities  -  March 

We  could  not  determine  if  the  patient  was  referred  from  Quantico  or  not.  With  the 
exception  of  Problem  it2,  the  staff  gave  this  patient  the  correct  information  about 
"the  system"  for  being  seen.  Four  hours  later,  however,  the  patient  and  his  fathe; 
left....  The  dad  said  that  he  would  followup  with  a  formal  complaint,  but  at  this 
time,  he  has  not. 

6.  Add.itional  tasks  managed  by  the  P.R.O.  during  this  month  are: 

a.  provided  new  MEDDAC  employees  with  a  brief  orientation  to  the  Patient 
Representative  Office, 

b.  attended  Potomac  Chapter  Society  of  Patient  Representatives  Meeting  at 
Washington  Adventist  Hospital  in  Takoraa  Park,  and 

c.  shared  job  description,  monthly  report  and  records  ideas  with  staff  from 
Fort  Rucker,  Fort  Lee,  and  Fort  Leavenworth  respectively. 

7.  If  you  have  any  comments  or  questions  regarding  the  information  that  is  present 
in  this  monthly  report,  please  contact  me  at  ext.  A2890. 

%mOu/r>(ict/io 

PAMELA  N.  DUNCAN 
Patient  Representative 

DISTRIBUTION;  «  " 

XO 

CPS 

C,  Dept,  of  Family  Practice 
C,  Dept,  of  Medicine 
C,  Dept,  of  Nursing  (2) 

C,  Dept,  of  Surgery 
C,  Ambulatory  Nursing  Svc. 

C,  CMHA 
C,  CSD  (3) 

C,  Logistics 
C,  EMS 

C,  PAD  ■  ^ 

C,  Pathology 
C,  Pharmacy 

C,  Preventive  Medicine 
C,  Radiology 
Commander,  15th  CSK 
Comiminder,  MED,  CO. 

Navy/MC  Liaison 

ore,  OItiu; 

A'liu.i.a.  KL’sidrftic 
C,  Force  Development 
,C,  Satellite  Clinics 


1  Incl. 
as 
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MCyni;  /T)/i/?Oh  -PATIENT  PROBLEM /COMPL/ INTS 


APPENDIX  I 


QA  PROBLEM  ASSESSMENT  WORKSHEET 


QUALITY  ASSURANCE  PROGRAM 
PROBLEM  ASSESSMENT  WORKSHEET 


SECTION  I -IDENTIFICATION 

A.  Statement  of  Problems: 


Date 


B.  Source  of  Data: 

C.  Committee/Office/ Individual  Identifying  Problem: 

D.  Recommended  Individual/Committee/Activity  to  investigate  Problem: 


SECTION  II-ASSESSMENT  Date 

A.  Identify  Applicable  Criteria? 

B.  Feasible  Resolutions; 

C.  Recommended  Resolutions: 

D.  Resources  Required; 


SECTION  Ill-Executive  Review  Date 


A.  Action  Taken: 


fl.  Priority:  _ Immediate-Resolve  within  days-review  monthly. 

_ Delayed-Resolve  within  6  months-review  monthly. 

_ Pa-ti.ue -Rosoivc  ’.-•ithia  5  )'()ars- review  ennLialJy. 

_ ^Ue  for  red- Resolution  not  feasible  with  current 

resources-review  annually. 


Ml'.DllAC:  (CS!))  FORM  522 
i  A[ir  I  L  I'.iSi 
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SECTIOM  IV- IN- PROGRESS  REVIEIVS 

A.  Status:  Date 

B.  Status:  Date 

C.  Status;  Date 

D.  Status:  Date 

E .  S  tutus ;  Date 

SECTION  V-RESOLimON 

Statement  of  Resolution:  Date_ 

SECTION  VI  -  FOLLOW-UP/ REVIEIV 

Date 
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APPENDIX  J 
ONE  SAMPLE  ANALYSIS 


I 

X  (I) 

X(I+1) 

1 

16.0700 

16.2200 

3 

15.6800 

17.2500 

5 

17.1100 

1 6 . 5900 

7 

16. 1800 

16.3000 

9 

16.0200 

15.9500 

11 

16.5300 

16.8900 

13 

16.3700 

16.3800 

15 

16.2500 

16.1100 

17 

16.4100 

16.2500 

19 

15.8700 

16.4100 

21 

16. 1000 

16.2000 

23 

16.6100 

16.4800 

25 

16.7400 

BASIC  STATISTICS 
N  =>  25 

STD  ERROR  OF  THE  HEAN«  .07 

MEAN  «  16.3588 

COEF  OF  VARIATION  »=  2.257. 

VARIANCE  «  . 1354 

STANDARD  DEVIATION  »  .3680 


SKENNESS 

KURTOaiS 


.6516 

3.2807 
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APPENDIX  K 

PAIRED  SAMPLE  ANALYSIS 
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APPENDIX  L 


CHI  SQUARE  TEST 


CHI-SQUARE  EXPECTED  VALUES 


r-  6 


OBSERVED 

FREQUENCY 


EXPECTED 

FREQUENCY 


1 

25.00 

20.00 

2 

17.00 

20.  00 

3 

15.00 

20.00 

4 

23 . 00 

20.00 

5 

24.00 

20.00 

6 

1 6 . 00 

20.00 

CHI-SQUARE- 

■  5.0000 

K»  6 

DF-  5 

PROB  CHI-SQUARE  > 

5.0000 

n 

.4159 

CHI-SQUARE 

EXPECTED  VALUES 

I 

0(1) 

Ed) 

1 

0.0000 

9.6000 

2 

50. 0000 

46.7500 

3 

47. 0000 

51.8500 

4 

5S.0000 

54.4000 

5 

5. 0000 

8.2500 

6 

14. 0000 

9. 1500 

6 

I 

OBSERVED 

EXPECTED 

FREQUENCY 

FREQUENCY 

1 

8.00 

9.60 

50 . 00 

46.75 

47.00 

51.85 

4 

56 . 00 

54.40 

5 

5 . 00 

8.25 

6 

1 4 . 00 

9.  15 

CHI-SQUARE«  4.8444 

h:>  6 

DF«  5 

PROD  CHI-SQUARE  >  4.8444 


.  4352 
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APPENDIX  M 
C  CONTINGENCY 


CHI-SQUARE  R  X  C  CONTINSENCY  TABLE 


CELL  FREQUENCY 

ROW  1  :  80  120 

ROW  2  s  170  130 


ROW  1  s  80  120 

ROW  2s  170  130 


TOTALSs 


COLUMN 

TOTAL 

C<  1)  “ 

250 

C<  2)  « 

250 

ROW 

TOTAL 

R(  1)  ■= 

200 

R(  2)  = 

300 

OVERALL" 

500 

EXPECTED 

FREQUENCY 

ROW  1  s 

100.00 
100. 00 


ROW  2  s 

150.00 

150.00 


#  OF  EXP.  FREQ.  <«=2  =  0 
•/,  EXP.  FREQ.  <=5  =  0.007. 


CHI-SQUARE  =  13.3333 

CONTINGENCY  COEFFICIENT  = 


.  1612 


F-  1 

ROB  CHI-SQUARE 


.  0003 
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APPENDIX  N 


TWO  SAMPLE  T-TEST 


t  STATISTIC  FOR  THE  MEANS  OF  TWO 


SAMPLES 


SAMPLE 
N  »  10 


1 


I  X<I> 

1  184.0000 

2  22.0000 

3  40.0000 

4  129.0000 

5  26.0000 

6  47.0000 

7  138.0000 

8  42.0000 

9  84.0000 

10  173.0000 


SAMPLE  2 
N  «  12 


I 

Y(I) 

1 

192.0000 

2 

64.0000 

3 

235.0000 

4 

223.0000 

5 

66.0000 

6 

224.0000 

7 

4 1 . OOOC 

8 

51.0000 

9 

152.0000 

10 

144.0000 

11 

68. 0000 

12 

186.0000 

N  FOR  1  =  10 

1  MEAN  =  88.5 

STD.  DEV.  FOR  1  “  62.304 


N 


FOR  2  = 
MEAN  = 
iTD.  OEV. 


12 

137. 166666667 

FOR  1  =  75.083 


t=  1.6325  DF=  20 

PROB  t  >  1.6325  =  .0591 
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APPENDIX  0 


ONE-WAY  ANALYSIS  OF  VARIANCE 


ONE  WAY  ANALYSIS  OF  VARIANCE 


TRT  #  1 

93.00 

50.00 

55.00 

76.00 

94.00 

86.00 

75.00 

80.00 

67.00 

70.00 

90.00 

85.00 

74.00 

90.00 

87.00 

69.00 

TRT  #  2 

66.00 

65.00 

50.00 

65.00 

62.00 

57.00 

59.00 

64.00 

64.00 

63.00 


TREATMENT  #  1  OBS.# 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 


VALUE 

93.00 

50.00 

55.00 

76.00 

94.00 

86.00 

75.00 

80.00 

67.00 

70.00 

90.00 

85.00 

74.00 

87.00 

69.00 

90.00 


TREATMENT  #  2 


OBS.# 

1 

2 

3 

4 

5 

6 
7 

a 

9 

10 


VALUE 
66.00 
65.00 
50.00 
65.00 
62.00 
57.00 
59.00 
64.00 
64 . 00 
63.00 


TRT.#  N 
1  16 
2  10 


MEAN 
77.5625 
61 . 5000 


VARIANCE 

171.4625 

24.2778 


DF  NUM»  1 
DF  DEN«  24 
F»  13.6356 

PROB  F  >  13.6536=  .0011 

BARTLETT'S  TEST 
DF-  1 

CHI-SQUARE-  7.9111 

PROB  CHI-SQUARE  >  7.9111 

-  . 0049 
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APPENDIX  P 


TWO-WAY  ANALYSIS  OF  VARIANCE 


TWO  WAY  ANALYSIS  OF  VARIANCE 


R=  3 
C=  3 
N=  2 

ROW  COLUMN  OBSERVATIONS 


1 

1 

3.00 

3.00 

2 

4.00 

3.00 

■:> 

3.00 

4.00 

2 

1 

6.00 

4.00 

6 . 00 

7.00 

3 

8.00 

5.00 

*T 

1 

3.  00 

4 . 00 

2 

6.  00 

7.00 

3 

5 . 00 

6.00 

ROW 

COL 

CELL  MEAN 

CELL  VAF 

1 

1 

3.000 

0.  000 

2 

3.500 

0.500 

3 

3.  500 

0.500 

o 

1 

5.000 

2.  000 

2 

6 .  500 

0 . 500 

3 

6.500 

4.500 

3 

1 

3.500 

0.  500 

o 

4L 

6 . 500 

0.500 

3 

5 .  500 

0 . 500 

ROW  1 

'1EANS 

1: 

ROW 

MEAN 

-r  “jnnr 

1 

'7 

6 . 000 

5.  167 

COL  1 

MEANS 

i: 

COL 

MEAN 

1 

3.833 

4L. 

5.500 

3 

5.  167 
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OVERALL  MEAN 


4.833 


ANALYSIS  OF  VARIANCE 


SOURCE /DF 

SS 

MS 

F 

TOTAL 

17 

44.5 

ROWS 

2 

22.3 

11.2 

10.6 

COLS 

2 

9.3 

4.7 

4.4 

RXC 

4 

3.3 

0.8 

0.8 

ERROR 

9 

9.5 

1.  1 
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APPENDIX  Q 

MULTIPLE  LINEAR  REGRESSION 


^ATA 

SET  l5 

I 

X<I) 

1 

13300.0000 

2 

9300. 0000 

3 

120.0000 

4 

6700.0000 

(Y) 

5 

28.0000 

DATA  SET  2a 

I 

X  (I) 

1 

21000.0000 

2 

11300.0000 

3 

823.0000 

4 

9300.0000 

(Y> 

5 

24.0000 

DATA  SET  3: 

I 

X  <I) 

1 

16800.0000 

2 

10700.0000 

3 

771.0000 

4 

8250.0000 

(Y) 

5 

42.0000 

DATA  SET  4: 

I 

X<I) 

1 

17300.0000 

2 

1 1 700 . 0000 

3 

709.0000 

4 

8300 . 0000 

(Y) 

5 

29.0000 

DATA  SET  5b 

I 

X(I) 

1 

13500.0000 

2 

11700.0000 

3 

836.0000 

4 

9800. 0000 

<Y) 

5 

13.0000 

DATA 

SET  6: 

I 

X  (I) 

# 

1 

13016.0000 

9600. 0000 

3 

844.0000 

4 

8100. 0000 

(Y) 

5 

9.0000 
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1 

18200.0000 

2 

12200. 0000 

3 

893.0000 

4 

10900. 0000 

(Y) 

S 

36.0000 

DATA  SET 

St  I 

X  (I) 

1 

14300.0000 

2 

10200.0000 

3 

734.0000 

4 

9500. 0000 

<Y) 

5 

24.0000 

DATA  SET 

9s  I 

X  (I) 

1 

18700.0000 

2 

1 1 100. 0000 

3 

835.0000 

4 

9300. 0000 

(Y) 

5 

50.0000 

DATA  SET 

10:  I 

X(I) 

1 

18300.0000 

2 

9700 . 0000 

3 

701.0000 

4 

6800 . 0000 

(Y) 

5 

68.0000 

1 

1 

VAR 

MEAN 

VARIANCE 

j 

X  (  1) 

16441.6000 

« 

X  <  2) 

10750.0000 

• 

1 

X  (  3) 

726.6000 

49493. 1556 

X  (  4) 

8695. 0000 

• 

X  (  5) 

32.3000 

308.6778 

CORRELATION  HATRIX 

1  1 

.  000 

. 463  1 . 

000 

T 

.380 

586  1 . 000 

4 

.  223 

796  . 677 

1 . 000 

♦  . 

.560 

093  -.028 

-.298 

1 . 000 
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MULTIf^-LE 

CORRELATION  «  .509 

ANALYSIS  OF  VARIANCE 


SDURCE/DF 

ss 

MS  F 

lUSTAL 

9 

2778. 1 

4 

1415.2 

353.8 

1.3 

X  (  1) 

1 

870.3 

870.3 

3.2 

X  (  2) 

1 

438.8 

438.8 

1.6 

X  (  3) 

1 

14.2 

14.2 

0.  1 

X  <  4) 

1 

91.9 

91.9 

0.3 

RES  ID 

5 

1362.9 

272.6 

COEFFICIENTS 

I  B(I)  VARIANCE  TVALUE 


0 

1 

2 


27.046 

0.004 

-0.003 

0.003 

-0.005 


0.000 

0.000 

0.001 

0.000 


1.801 

-0.257 

0.089 

-0.581 
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